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Abstract 

The main goal of this paper is to study the geometric structures associated with the representation of 
tensors in subspace based formats. To do this we use a property of the so-called minimal subspaces which 
allows us to describe the tensor representation by means of a rooted tree. By using the tree structure 
and the dimensions of the associated minimal subspaces, we introduce, in the underlying algebraic tensor 
space, the set of tensors in a tree-based format with either bounded or fixed tree-based rank. This class 
contains the Tucker format and the Hierarchical Tucker format (including the Tensor Train format). In 
particular, we show that the set of tensors in the tree-based format with bounded (respectively, fixed) 
tree-based rank of an algebraic tensor product of normed vector spaces is an analytic Banach manifold. 
Indeed, the manifold geometry for the set of tensors with fixed tree-based rank is induced by a fibre 
bundle structure and the manifold geometry for the set of tensors with bounded tree-based rank is given 
by a finite union of connected components where each of them is a manifold of tensors in the tree-based 
format with a fixed tree-based rank. The local chart representation of these manifolds is often crucial 
for an algorithmic treatment of high-dimensional PDEs and minimization problems. In order to describe 
the relationship between these manifolds and the natural ambient space, we introduce the definition of 
topological tensor spaces in the tree-based format. We prove under natural conditions that any tensor of 
the topological tensor space under consideration admits best approximations in the manifold of tensors 
in the tree-based format with bounded tree-based rank. In this framework, we also show that the tangent 
(Banach) space at a given tensor is a complemented subspace in the natural ambient tensor Banach space 
and hence the set of tensors in the tree-based format with bounded (respectively, fixed) tree-based rank 
is an immersed submanifold. This fact allows us to extend the Dirac-Frenkel variational principle in the 
bodywork of topological tensor spaces. 
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1 Introduction 

Tensor approximation methods play a central role in the numerical solution of high dimensional problems 
arising in a wide range of applications. Low-rank tensor formats based on subspaces are widely used for 
complexity reduction in the representation of high-order tensors. The construction of these formats are 
usually based on a hierarchy of tensor product subspaces spanned by orthonormal bases, because in most 
cases a hierarchical representation fits with the structure of the mathematical model and facilitates its 
computational implementation. Two of the most popular formats are the Tucker format and the Hierarchical 
Tucker format [TB] (HT for short). It is possible to show that the Tensor Train format [25] (TT for short), 
introduced originally by Vidal S3, is a particular case of the HT format (see e.g. Chapter 12 in [11]). An 
important feature of these formats, in the framework of topological tensor spaces, is the existence of a best 
approximation in each fixed set of tensors with bounded rank m- In particular, it allows to construct, on a 
theoretical level, iterative minimisation methods for nonlinear convex problems over reflexive tensor Banach 
spaces [Ill- 

Tucker tensors of fixed rank are also used for the discretisation of differential equations arising in quantum 
chemical problems or in the multireference Hartree and Hartree-Fock methods (MR-HF) in quantum dynam¬ 
ics [251 . In particular, for finite dimensional ambient tensor spaces, it can be shown that the set of Tucker 
tensors of fixed rank forms an immersed finite-dimensional quotient manifold [22]. A similar approach in a 
complex Hilbert space setting for Tucker tensors of fixed rank is given in [T] . Then the numerical treatment 
of this class of problems follows the general concepts of differential equations on manifolds m- Recently, 
similar results have been obtained for the TT format ED] and the HT format m (see also El)- The term 
’’matrix-product state” (MPS) was introduced in quantum physics (see, e.g., El]). The related tensor rep¬ 
resentation can be found already in [35j without a special naming of the representation. The method has 
been reinvented by Oseledets and Tyrtyshnikov (see [25], [21], and [BUD and called ”TT decomposition”. For 
matrix product states (MPS), the differential geometry in a finite-dimensional complex Hilbert space setting 
is covered in US¬ 
As we will show below, the Tucker and the HT formats are completely characterised by a rooted tree 
together with a finite sequence of natural numbers associated to each node on the tree, denominated the tree- 
based rank. Each number in the tree-based rank is associated with a class of subspaces of fixed dimension. 
Moreover, it can be shown that for a given tree, every element in the tensor space possesses a unique tree- 
based rank. In consequence, given a tree, a tensor space is a union of sets indexed by the tree-based ranks. 
It allows to consider for a given tree two kinds of sets in a tensor space: the set of tensors of fixed tree-based 
rank and the set of tensors of bounded tree-based rank. Two commonly accepted facts are the following. 
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(a) Even if it can be shown in finite dimension that the set of Tucker (respectively, HT) tensors with 
bounded tree-based rank is closed, the existence of a manifold structure for this set is an open question. 
Thus the existence of minimisers over these sets can be shown, however, no first order optimality 
conditions are available from a geometric point of view. 

(b) Even if either in finite dimension or in a Hilbert space setting it can be shown that the set of Tucker 
(respectively, in finite dimensions HT) tensors with fixed tree-based rank is a quotient manifold, the 
construction of an explicit parametrisation in order to provide a manifold structure is not known. 

In our opinion, these two facts are due to the lack of a common mathematical frame for developing a 
mathematical analysis of these abstract objects. The main goal of this paper is to provide this common 
framework by means of the theory for algebraic and topological tensor spaces developed in e by some of 
the authors of this article. 

Our starting point are the following natural questions that arise in the mathematical theory of tensor 
spaces. The first one is: is it possible to introduce a class of tensors containing Tucker, HT (and hence TT) 
tensors with fixed and bounded rank? A second question is: if such a class exists, is it possible to construct a 
parametrisation for the set of tensors of bounded (respectively, fixed) rank in order to show that it is a true 
manifold even in the infinite-dimensional case? Finally, if the answers to the first two questions are positive, 
we would like to ask: is the set of tensors of bounded (respectively, fixed) rank an immersed submanifold of 
the topological tensor space, as ambient manifold, under consideration? 

The paper is organised as follows. 

• In Sect. H we introduce the tree-based tensors as a generalisation, at algebraic level, of the hierarchical 
tensor format. This class contains the Tucker tensors (among others). Moreover, we characterise the 
minimal subspaces for tree-based tensors extending the previous results obtained in e and introducing 
the definition of tree-based rank. In particular, the main result of this section, Theorem 12.191 is a 
characterisation of the set of parameters needed to provide an explicit geometric representation for the 
set of tensors with fixed tree-based rank. 

• In Sect. H by the help of Theorem 12.191 we show that in an algebraic tensor product of normed 
spaces the set of tensors with fixed tree-based rank is an analytic Banach manifold. Indeed, we give an 
explicit atlas and we prove that this atlas is induced by a fibre bundle structure. This result allows us 
to deduce that the set of tensors with bounded tree-based rank is also an analytic Banach manifold. 
An important fact is that the geometric structure of these manifolds is independent on the ambient 
tensor Banach space under consideration. 

• In Sect. 21 we discuss the choice of a norm in the ambient tensor Banach space (a) to show the existence 
of a best approximation for the set of tensors with bounded tree-based rank and (b) to prove that the 
set of tensors with fixed tree-based rank is an immersed submanifold of that space (considered as 
Banach manifold). To this end we assume the existence of a norm at each node of the tree not weaker 
than the injective norm constructed from the Banach spaces associated with the sons of that node. 
This assumption generalises the condition used in El to prove the existence of a best approximation 
in the Tucker case. More precisely, under this assumption, 

— we provide a proof of the existence of best approximation in the manifold of tensors with bounded 
tree-based rank, 

— we construct a linear isomorphism, at each point in the manifold of tensors with fixed tree-based 
rank, from the tangent space at that point to a closed linear subspace of the ambient tensor 
Banach space, this subspace being given explicitly, 

— we show that the set of tensors with fixed tree-based rank is an immersed submanifold, 

— we also deduce that the set of tensors with bounded tree-based rank is an immersed submanifold. 

• In Sect. [5j we give a formalisation in this framework of the multi-configuration time-dependent Hartree 
MCTDH method (see [215]) in tensor Banach spaces. 
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2 Algebraic tensors spaces in the tree-based Format 

2.1 Preliminary definitions and notations 

Concerning the definition of the algebraic tensor space a (S)j=i b generated from vector spaces Vj (1 < j < d), 
we refer to Greub M- As underlying field we choose R, but the results hold also for C. The suffix ‘a’ in 
a (S>j=i b re f ers to the ‘algebraic’ nature. By definition, all elements of 

d 

V:= a 0b 

i=i 

are finite linear combinations of elementary tensors v = 0^ =1 v j ( v j G b) ■ f je f P := {t ■ •■, d} be the index 
set of the ‘spatial directions’. In the sequel, the index sets D\{j} will appear. Here, we use the abbreviations 

Vj,] := „ 0 14 , where 0 means 0 . 

kjtj k^j k£D\{j} 

Similarly, elementary tensors v k are denoted by vyj. The following notations and definitions will be 

useful. 


For vector spaces Vj and Wj over R, let linear mappings Aj : Vj —> Wj (1 < j < d) be given. Then the 
definition of the elementary tensor 

d d d 

A = 0 Aj : V = a 0) Vj > W = Q 0 Wj 

j—i j=i j =l 

is given by 

Note that (12.1H uniquely defines the linear mapping A : V —> W. We recall that L(V, W) is the space of linear 
maps from V into W, while V' = L(V, R) is the algebraic dual of V. For metric spaces, C(V 7 W) denotes the 
continuous linear maps, while V* = C(V, R) is the topological dual of V. Often, mappings A = 0‘? =1 A 
will appear, where most of the Aj are the identity (and therefore Vj = Wj). If A k G L(V k ,W k ) for one k 
and Aj = id for j ^ fc, we use the following notation: 

id[ fc ] <g) A k := id® . . .®id, ® A k ® id ® . . . ® id G L(V, V[ fc ] ® a W k ), 

k— 1 factors d—k factors 


0)(A" l ’t)- (2-1) 



provided that it is obvious which component k is meant. By the multiplication rule Aj J o Bj j = 

0^ =1 (Aj o Bj) and since id o Aj = Aj o id , the following identitjf] holds for j k: 

id ® ... ® id ® Aj ® id ® ... ® id ® A k ® id ® ... 0 id 
= (idyj ®Aj) o (id [fc] <8i A k ) 

= (id[ fe ] ®A k )o (idyj < 8 > Aj) 

(in the first line we assume j < k). Proceeding inductively with this argument over all indices, we obtain 

d 

A = 0) Aj = (idqj <g> A{) o ■ ■ ■ o (id [d] ® A d ). 

3 = 1 

^■Note that the meaning of idm and id^j may differ: in the second line of (12.21) . (idjfc] <g> A k ) G L(V, ~V[k] Wfc) and 
(idyjSAf) G L (V [fc] ®a w k , V [j,k] Wj W k ) , whereas in the third one (idyj ®Aj) G L(V, Vyj (g> a Wj) and (id[fc] <g> A k ) G 
L (Vp] ®a IFj'i ®a Wj <3> a W k ) . Here = a V. ■ 
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If Wj = K, i.e., if Aj = ipj £ V- is a linear form, then idyj ® <pj € L(V, Vyj) is used as symbol for 
id® ... ® id® ipj ® id ® • • • 0 id defined by 


( id m ® Vj) 



Vj(vj) ■ (£)Vk- 


Thus, if p = ®j =1 pj £ ® =1 VI, we can also write 


V = ®j =1 ifj = (id[!] ® v?r) o • • • o (id[rfj ® ip d )- (2.2a) 

Consider again the splitting of V = a (S)j= 1 Vj into V = Vj ® a V ^ with V^j := a ® fc . ■ 14 ■ For a linear 
form <p^ £ VC, the notation idj ® tpy] € L(V, Vj) is used for the mapping 


{idj ® <p b] ) ^0 = p {j] ^ 


kM 


Vk ■ Vj. 


( 2 . 2 b) 


If = <8> k pj Vk £ a <S> k ^j K is an elementary tensor, <p^ (® k ^j v (k) ) = Ukjtj Vk holds in (|2.2bD . 

Finally, we can write (12.2al) as 

V = ®j=iVj = Vj ° (idj ® Vy]) for 1 < j < d. 


2.2 Algebraic tensor spaces in the tree-based format 

We introduce the abbreviation TBF for ‘tree-based format’. For instance, a TBF tensor is a tensor repres¬ 
ented in the tree-based format, etc. The tree-based rank will be abbreviated by TB rank. To introduce the 
underlying tree we use the following example. 

Example 2.1 Let us consider D = {1, 2,3,4, 5, 6 }, then 

Vj = 

Observe that Vc = a ®® =1 Vj can be represented by the tree given in Fiaure UTH and Vd = Vi 23 < 8 > a V 45 <g> a I /6 
by the tree given in Figure HOI We point out that there are other trees to describe the tensor representation 
V D = V 123 ® a V 45 < 8 > a V 6 , because 



'Vj 


'Vj 


V 6 =V 


123 


Da V. 


45 


Vfi. 


3 =1 


3 =4 


V D = 


'Vj 


'Vj 


Ve= l Vj 


. 7=1 


1=4 



a \ a Q<)Vj ] ® a V 6 , 
j =4 


that is, V 123 = a ®) = 1 Vj = Vi ® a V 23 (see Figure [0)1 . 

The above example motivates the following definition. 

Definition 2.2 The tree Tjj is called a dimension partition tree of D if 

(a) all vertices a £ Tu are non-empty subsets of D, 

(b) D is the root ofTjj , 

(c) every vertex a £ Tp with ffa > 2 has at least two sons. Moreover, if S(a) C 2 D denotes the set of 
sons of a then a = U^g s(a)P where (3 FI (3' = 0 for all 13,(3' £ 5(a), (3 7 ^ (3', 

(d) every vertex a £ To with ffa = 1 has no son. 
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{1,2,3,4,5,6} 



{1} {2} {3} {4} {5} { 6 } 


Figure 2.1: A dimension partition tree related to Va = a ®® =1 Vj . 


{1,2,3,4,5,6} 



{1,2,3} {4,5} { 6 } 



{1} {2} {3} {4} {5} 

Figure 2.2: A dimension partition tree related to Vd = V 123 V 45 F 6 . 

If S(a) = 0, a is called a leaf. The set of leaves is denoted by C{Td). An easy consequence of Definition ^. 21 
is that the set of leaves C{Td) coincides with the singletons of D , i.e., C(Td) = {{}} : j £ D}. 

Example 2.3 Consider D = {1, 2, 3,4, 5, 6 }. Take 

T d = {D, {1}, {2}, {3}, {4}, {5}, { 6 }} and S(D) = {{1}, {2}, {3}, {4}, {5}, { 6 }} 

(see Figure HO)] . Then S(D) = C(Td). 

Example 2.4 In Figure HOI we have a tree which corresponds to V d = V 123 < 8 > a V 45 0 O V@. Here D = 
{1, 2,3,4, 5, 6 } and 

T d = {D, {1, 2, 3}, {4, 5}, {1}, {2}, {3}, {4}, {5}, { 6 }}, 

S(D) = {{ 1 , 2 , 3}, {4,5}, { 6 }}, S{{ 4,5}) = {{4}, {5}}, S({ 1, 2 , 3}) = {{1}, { 2 }, {3}}. 

Moreover C(T D ) = {{1}, {2}, {3}, {4}, {5}, { 6 }}. 

Finally we give the definition of a TBF tensor. 

Definition 2.5 Let D be a finite index set and Tp be a partition tree. Let Vj be a vector space for j e D, 
and consider for each a £ Td \ C(Td ) a tensor space V Q := a <S )/3 eS(a) ^P ■ Then the collection of vector 
spaces {V Q } Qg 7 ’ £) \{ 45 } is called a representation of the tensor space ~Vd = a® a eS(D)Va in tree-based 
format. 

Observe that we can write Vd = a ® a es(D) = o • A first property of TBF tensors is the 

independence of the representation of the algebraic tensor space V^j with respect to the tree Td- 


{ 1 , 2 , 3 , 4 , 5 , 6 } 



{1,2,3} {4,5} { 6 } 



{1} {2,3} {4} {5} 



{2} {3} 


Figure 2.3: A dimension partition tree related to Vd = V 123 < 8 > Q V 45 ® Q V% where V 123 = V\ ® a V 23 . 
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Lemma 2.6 Let D be a finite index set and Tjj be a partition tree. Let Vj be a vector space for j £ D. 
Assume that {V a } agTD \{£)} is a representation of the tensor space Vj = a® ae s(D) V <* tree-based 

format. Then for each a\ £ Tp\{D} there exist a.i ,..., a m £ Tp\{D, a\} such that D = ctiHaj = 0 

andV D = . 

2.3 Minimal subspaces for TBF tensors 

Let Vj be a vector space for j £ D , where D is a finite index set, and a \,..., a m C 2 D \ {D, 0}, be such 
that a,; fl ctj = 0 for all * / / and D = Ujli a j- For v £ a x V ai we define the minimal subspace of v 
on each V Qi := a ®j ea . Vj for 1 < i < m, as follows. 

Definition 2.7 For a tensor v £ a (S>jeD Vj = a®Z lV«„ the minimal subspaces denoted by 17™ n (v) C 
V Qi) for 1 < i < m, are defined by the properties that v £ a ®JLi U™ ln (v) and v £ n Uai implies 
t/“ in (v) c U Q1 . 

The minimal subspaces are useful to introduce the following sets of tensor representations based on 
subspaces. Fix r = (r\,... ,rd) £ N d . Then we define the set of Tucker tensors with bounded rank r in 

V=a®U V > b y 

T r (V) :={veV: dimC/f in (v) < Tj, 1 < j < d) , 
and the set of Tucker tensors with fixed rank r in V = a ®j =1 Vj by 

M r (V) :={v£V: dim t/“ in (v) = Vj, 1 < j < d} . 

Then M r (V) C T r (V) C V holds. 

The next characterisation of U™' n (v) for 1 < j < m is due to [19] (it is included in the proof of Lemma 
6.12). Since we assume that V a . are vector spaces for 1 < j < m, then we may consider the subspaces 

^4(v) := {(id aj ® V [aj] )(v) : <p [aj] £ } 

and 

U " (v) := {(idey ® Vk-])(v) : <p [aj] G a 0 fc?4j . C/” fc in (v)' } , 
for 1 < j < to. Moreover, if V aj are normed spaces for 1 < j < m we can also consider 

U "/( v ) : = : ¥>[«,] e » 0,^ ’ 

and 

:= 0 ^k-])( v ) : vvd e «0 Mj w*}> 

Theorem 2.8 Assume that V a . are vector spaces for 1 < j < m. Then the following statements hold. 

(a) For any v £ V = a ®yLi V Qj ., it holds 

< n (v) = ^,(v) = t/4 7 (v), 

/or 1 < j < m. 

(b) Assume that V aj are normed spaces for 1 < j < m. Then for any v G V = a V aj , ft holds 

tC( v ) = 0) = W 

/or 1 < / < m. 
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Let D = U %LiCti be a given partition. Assume that a\ = Uf =1 /3j is also a given partition, then we have 
minimal subspaces t/^ ln (v) C V^ = a <S> fee/3j . 14 for 1 < j < n and t/“ ln (v) C V Qi = a <S> fcgai 14 for 
1 < i < to. Observe that V ai = a 0 " =1 V^. , where 

m ( n \ / m 

V e a 0 t/“ in (v) and v e L 0 i/£ in (v) 0 O «, 0 t/” in (v) 

i=l \ i=l / V i=2 

Example 2.9 Let us consider D = {1, 2, 3,4, 5, 6 } and the partition tree Tfo given in Figure flOH Take 
v e Vj = V ai 0 a V a2 0 a Vq, 3 , where op = {1,2,3}, 02 = {4,5}, and <23 = { 6 }. Then we can 

conclude that there are minimal subspaces Ufj ln (v) for v = 1,2,3, such that v E a &„ =1 ^™ m ( v ) ani i a ^ s0 
minimal subspaces [/™ m (v) for j E D, such that v E a(£)j eD 

The relation between t/j nm (v) and L}(|} ln (v) is as follows (see Corollary 2.9 of pT|l. 

Proposition 2.10 Let Vj be a vector space for j E D, where D is a finite index set, and D = U^L 1 ai be a 
given partition. Let v E a ®j^£, Vj . For a partition a.\ = U JLiPj it holds 

m 

3 =1 

The following result gives us the relationship between a basis of C™ m (v) and a basis of £/™ ln (v) for 
1 < j < m. 

Proposition 2.11 Let Vj be a vector space for j E D , where D is a finite index set. Let a C D such 
that a = U"=i a o where 0 ^ ati are pairwise disjoint for 1 < i < m. Let v E a ® J g £> L} . The following 
statements hold. 



(a) For each 1 < i < m, it holds 


t/“ in (v) = span j 

| (id ai 0 v^ ( “ Xa<) 

) ( v «) 

: v a E t/” in (v) 

and ip( a \ ai ’ 

’ e «0 
k^i 

= span | 

( id ai 0 v^ ( “ Vai) 

) ( v «) 

: v a E EC in (v) 

and 

1 € «0 
k^i 



(b) Assume thatV a := a®{4 1 V Q , i and V ai , for 1 < i < m, are normed spaces. For each 1 < i < m it 
holds 


C“ in (v) = span J ( id ai 0 (v Q ) : v Q E t/“ in (v) and E a 0 U™ n (v)* 

\ kVi 

= span J (id ai 0 (v Q ) : v a E t/“ m (v) and E „0V* 


k^i 


Proof. Statements (a) and (b) are proved in a similar way. Let 7 = D \ a and write 7 = (J " =1 where 

0 7 ^ 7 i C D are pairwise disjoint for i = 1,2,..., n. In particular, to prove (b), we observe that 


Vz, 


V Q 0 a V 7 = a 0 V Qi 

V i=i 
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Then, by Theorem 12. 8 f bb using U™ (v), we have 


C/“ m (v) = { ( id a 0 <p ( 7 ) )(v) : v (l) G Q (X) t/ 7 min (v)* V and 


j=i 


£C» = <1 (id ai ®v (DXai) )(y) ■■ v (DW) G ( a(^)t/“ in (v)* 


ky£i 


>a | a \^jy ^ -y^- 

i=i 


e/ 7 T»* 


for 1 < i < m. Take v a £ C/™ ln (v). Then there exists ip^ £ a <S>jLi U™ ln (v)* such that v Q = ( id a 0 ip^) (v). 
Now, for (p( a \ a *) £ a 0 fe ^ H“ ln (v)* , we have 

(id ai 0 <p (a \ ai) 'J (v Q ) = (id ai 0 0 (p( D \ a ^ (v), 

and hence ( id ai 0 ip( a \ ai )) (v a ) G C^“ ln ( v )- Now, take v ai £ f7™ m (v), then there exists 


€ | a 0 c/-in (v) * j | a 0 f/™ in (v)* I 
\ / \ i =1 / 

such that v ai = (id ai 0 (v). Then ip ( - D \ OIi '> = 0 </>[ 7 \ where </> ; (7 ^ £ a <3>jLi K)“ n (v)* 

and ip[ a \ OLi ' > £ a <S>k^i ^™( v )* for 1 < l < r. Thus, 

v ai = (id ai 0 < < 5 (£ ’\“ i) ^ (v) 

= ^2 (id ai 0 0 4> j 7 ^ (v) 

2=1 

= ^ (idai 0 ip\ a ^ ai) ) (i id a ® ^>- 7 , )(v)j . 

2=1 

Observe that ( id a 0 0 ; ( 7 ^)(v) £ 17“ ln (v). Hence the other inclusion holds and the first equality of statement 
(b) is proved. To show the second inequality of statement (b), we proceed in a similar way by using 
Theorem 12. 8 f bi and the definition of H 77 / (v). ■ 


From now on, given I / a C fl, we will denote V a := a <S>je a Vj ■> r a ’■= dim/7™ n (v) and t/™ m (v) := 
spanjv}. Observe that for each v £ Vo we have that (dim t/™ m (v)) ag 2 D \{ 0 } is i n N 2#D_1 . 

Definition 2.12 Let D be a finite index set and Tjj be a partition tree. Let Vj be a vector space for 
j £ D , Assume that {Vajag^qo} is a representation of the tensor space Vo = a ® q( =s(,d) in the 
tree-based format. Then for each v £ Vo = Q 0 j£D Vj we define its tree-based rank (TB rank) by the tuple 
(dimf/ a mill (v)) a£TD eN# T ”. 

In order to characterise the tensors v £ V D satisfying (dim U™ ln (v)) ctg T D = t, for a fixed r := (r ct ) ag T D G 
N* Td , we introduce the following definition. 

Definition 2.13 We will say that t := {r a ) a ^T D G N #T ° is an admissible tuple for To, if there exists 
v £ Vo \ {0} such that dimf7™ ln (v) = r a for all a £ Tjj \ {D}. 

Necessary conditions for r £ W^ Td to be admissible are 

VD = 1 , 

T{j} < dim Vj for {j} £ C(T D ), 

r a < n^es(a) r /3 for « G To \ C{T D ), 

rs < r a riqeS(a)\{« 5 } r P for a G To \ C(T D ) and <5 £ 5(a). 
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2.4 The representations of tensors of fixed TB rank 

Before introducing the representation of a tensor of fixed TB rank we need to define the set of coefficients 
of that tensors. To this end, we recall the definition of the ‘matricisation’ (or ‘unfolding’) of a tensor in a 
finite-dimensional setting. 

Definition 2.14 For a C 2 D , and (3 C a the map A4p is defined as the isomorphism 

Mp: ->• M(n M6/3 n.)x(n i6aV3 r«) ) 

It allows to introduce the following definition. 

Definition 2.15 For a C 2 D , let We say that Cif and only if 

H (det (M li (C^)M li (C^) T ) +det >0, 

where A £ R^’dhbeav-o} ’ s ) for each ft £ a. We point out that this condition is equivalent to the 
condition that all MfoC^) have maximal rank. 

Since the determinant is a continuous function, R*'' 6 “ r '' is an open set in R x 


Definition 2.16 Let Tjj be a given dimension partition tree and fix some tuple r £ N Td . Then the set of 
TBF tensors of fixed TB rank t is defined by 

FTAVd) ■■= {veV fl : dim t/“ in (v) = r a for all a £ T D ) (2.3) 

and the set of TBF tensors of bounded TB rank t is defined by 

3FT< x (V d ) ■■= {v £ Vd : dimt/™ in (v) < r a for all a £ T D } . (2.4) 

Note that iFT v (V d) = 0 for an inadmissible tuple r. For t,s€ N Td we write s < r if and only if s a < r a 
for all a £ To- Then we can also use the following notation 

AT< t (V D ) := { 0 } U |J FTfiVo). (2.5) 

s<r 


Next we give some useful examples. 

Example 2.17 (Tucker format) Consider the dimension partition tree of D := {1,... ,d}, where S(D) = 
C{Td) = {{j} : 1 < j < d}. Let (?’D,ri,... ,rd) be admissible, then ro = 1 and rj < dim Vj for 1 < j < d. 
Thus we can write 

FT<(i, ri ,...,r d )(V d) = 7( ri rjjfVo) 

and 

d~T, (1,7-1,...,r-<j) d) — A4 ( ri ,..., rd ) (Vd). 

Example 2.18 (Tensor Train format) Consider a binary partition tree of D := {1,...,d} given by 

T d = {D, {{j} : 1 < j < d}, {{j + 1,..., d} : 1 < j < d - 2}}. 

In particular, S({j ,..., d}) = {{j}, {j + 1,..., d}} for 1 < j < d — 1. This tree-based format is related to the 
following chain of inclusions: 


Ug in (v) c Uf n (v) U- in d (v) c Uf» U™ in (v) U™ n d (v) c 


c 


I U" lin 


(v). 


jeD 
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The next result gives us a characterisation of the tensors in FT x {y d)- 


Theorem 2.19 Let Vj be vector spaces for j £ D and Tjj be a dimension partition tree of D. Then the 
following two statements are equivalent. 


(a) v G J-T x (V d )- 

(b) There exists {u^ : 1 < ik < r*,} a basis of Uff ln (y) for k G £(Tb) where for each /r G To \ £(Tb) 
there exists a unique G R^ 1 * *' 3es(, ‘ ) rf> suc h that the set {u^ : 1 < i^ < r Q }, with 

u v )= E (E ^ ( 2 - 6 ) 


?(/*) R\ u (/3) 

'p)pes(n) 
l<ip<rp 0 eS((i) 

PeS(jM) 


for 1 < ifj, < Tfj, is a basis of UJf in (v) and 


= E ^ 


( i a ) a £ S (. D ) 'ey 

1 <i a <r a a&S(D) 

aeS(D) 


(2.7) 


Furthermore, if v G d) then (12.71) can be written for each a G S(D) as 

v= X u<“>®u‘;>. 

1 < 2 q, <r Q 


( 2 . 8 ) 


where ^™( I D)\{ a }( v ) = span{U,|“' : 1 < i a < r a }, and for each p, G Tjj \ C(Tn) we have 




where 


tt(p) ._ 
U W/3 ' 


u 


(<5) 


(m) , 

'ey 

SeS(ii) 

SES(fi) 8^/3 


(2.9) 


arirf C 7 SSo\{^}( v ) = U s^\{0}^) = s P an { U *E : 1 < ip < r/?} /° 


r 1 < v < r^. 


Proof. Assuming first that (b) is true, (a) follows by the definition of TT x (y d)- Now, assume that (a) 
holds. Since v G a ® a eS(D) ^ r a im ( v ) > there exists a unique G R x <*escD) r a that 


= E q 

1 < 2 q, <r a 
aeS(D) 


(D) 


U 


(a) 


a&S(D) 


where (u- a ^ : 1 < i a < r a } is a basit@ of f/™ ln (v). For each a G S(D) we set 


u( a ) := c (D) 

®<* ‘ /—-d (*/3 )/3 eS(D) 


,(/3) 


( 2 . 10 ) 


l<ip<rp 
0 eS(D) 
0^a 


0GS(D) 

0^a 


then (12771) can be written as m ■ From the definition of minimal subspaces we can write 

^s ( i S)\ {Q} (v) = {(id W ®p«)(v) : ^ G t/r n (v)*}. 


2 There are a small issue with the bold notation when a E S(fi) and a is a leaf, then u should not be bold. 
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We claim that {U-“^ : 1 < i a < r a } is a basis of ^™( 1 d)\{ q ,}( v )- To prove the claim assume that is 

a linear combination of {U : 2 < i a < r a }, then = Y^ 2 <i a <r a where \ ia ^ 0 for some 

2 <i a <r a . Thus, 

v = J2 ( u fi° + u i“ } ) ® u £° > 

2 <i a <r a 

since {u-“^ + : 2 < i a < r a } are linearly independent we have dimf7™ ln (v) < r a , a contradiction. 

Since {U-“^ : 1 < i a < r a } are linearly independent for each a G S(D ), from (12.81) we have that 


U S(D)\{ a }(v) = span{U-“ } : 1 < i a < r a }, 

and from ( 12 . 101 ) . we deduce that M a {C maps a basis into another one for each a € S(D) and hence 

y/ 

CW G R* ' 3es(D)r ' 3 . I n consequence, when S(D) = C{Td) statement (a) holds and then (12.71) gives us the 
classical Tucker representation. 

Next, assume S(D) ^ £(Td). Then, for each /r G Tn\{D} such that S(n) ^ 0, thanks to Proposition r2.10l 
we have 

^f n (v)Ca (g) f/r(v) • 

/3eS(/0 

Consider {u^ : 1 < < r M } a basis of J7™ ln (v) and {u-^ : 1 < ip < rp} a basis of Z7™ ln (v) for /3 G%) 

and 1 < ifj, < r^. Then, there exists a unique G ■qj) suc h that 



E cM 

V>(*0)/sesOO 


/3eS(/x) 



/3€S(m) 


for 1 < i/j, < Tfj,. Since {u^ : 1 < < r M } is a basis, we can identify with the matrix M. ^(C^), in the 

non-compact Stiefel manifold E which is the set of matrices in R^^hUestoo r f<) whose rows 

are linearly independent (see 3.1.5 in [I]). From (12.71) and (12.61) we obtain the Tucker representation of v, 
when S(D) ^ £(Td), as 


/ 


- E 


l<i k <r k 

k£C(T D ) 


\ 


E 


(D) 


l<i a <£« 
a£T D \{D} 
\ a <£C(T D ) 


r ^ TT cili) 

{'■a)a£S(.D) 11 V’ 


/XG T d \{D} 
S(/x)/0 


m.(*/ 3)/3 esw 


,(fe) 


( 2 . 11 ) 


k€C(T D ) 




here {u\ k : 1 < ik < fk} is a basis of £7™ m (v) for each k G £(Tp). To conclude, we claim that G 

R* mX ( 3eS( “ ) ^ for all /i G Tjj \ C(Tjy). To prove the claim we proceed in a similar way as in the root case, 
for each fixed 1 < and /? G 5(/x), we introduce (12.91) . Hence, we can write (12.61) as 


E 

l<ip< r p 


W V (P) 




where 1 < and /3 G S(/i). From Proposition 12. Ill ah we have 

f/™ in (v) = span | (idp ® ^ ( ^ } )(u^ } ) : 1 < *„ < r M and G 

= span < (idp < 8 > y>bA£))(u^) : 1 < < r M and g 


C/f n (v)' 


«€S(a»)\{/3} 


Vi 


<5 ! 


5G5( M )\{/3} 
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and hence U™ m (u^) C C/™ ln (v) for 1 < z M < r M . Let us consider {<p\^ : 1 < ip < r^} C J7™ ln (v)' a dual 

basis of the finite-dimensional space {u-^ : 1 < ip < rp}, that is, = Si fit j p for all 1 < ip,jp < rp, 

and /3 £ S(n). Thus, we have 


/ 




idp <g> 


(<5) 
try. ' 

i <5 sS(/j) I 

\ S^p ) 


(<) = £ C ?L„,» < „,< ) 6 

l<i/3<r/3 


for each multi-index ( js)ses(^)\p e X 5 e s( M ){l,... ,r 5 }. Then, for /? € ^(/x), 

s^p 




/ 


\ 


1 

span < 


zd /3 < 8 > 

0 

(<5) 

( u i^) : (Js)sbsm\p G X {!,- 

• ,ra}, 1 < V < r v\ 



l 

<5sS(m) 


<5e5(M) 




<5^/3 

Sjtp 

J 


with dim t/™ ln (v) = rp if and only if rankAd^C^) = rp for /3 e <5(/x). Finally, we have ^ 5es( ' l) 

for all i-L GTd \ C(Td) and the claim follows. Thus, statement (b) holds. 


To end the proof of the theorem, observe that in a similar way as above and by using idg^yp < 8 > for 
1 < jp < rp, over u[ /J) it can be proved that 

U ^)\{pM^) = span {U^ : 1 < ip < rp) 


for 1 < i/j, < and also 

U slH)\{p}M = s Pan {u£> i(J : 1 < ip < rp, 1 < *„ < ?>} . 

Now, we claim that ju,^^ : 1 < ip < are linearly independent in a §§ s ^p V 5 for 1 < z M < and /? £ 

S'(^z). Otherwise, there exist Aj p for 1 < ip < rp not all identically zero such that < r A^U-^^ = 0. 

Take w p G~Vp\ {0} and then 


w p ® 


V A- II (/3) 

.l<ip<rp 


E = 0 . 

l<ip<rp 


Observe that 




/ 

\ 

E ( a ^ w /3®u,ie) 

= V C^l. s Ai„ w« ® 

v>(*<5)zes(,u) ^ " 

0 


l<ip<rp 

Ki s <r s 

<5eS(/i) 

«5//3 

\5eS(/i) 

/ 


for 1 < < T/j, and /3 € take a dual basis of {ipf^ : 1 < is < ?’<5 } C V| of {u ? -^ : 1 < ip < ra} C Vg 

where (ujf) = 5 itJt for all 1 < is-,js < rg. Then we obtain 

idp®( (g) ( E ( A ^ w d® u S,))= E C ^HWs M Xi ^ = 0 ’ 

\5€S(m)\{/3} / \1 <if)<rf! ) 1 <ip<rp 

that is, Mp{C^) T zp = 0, where z p := (A^w^)^^. Since rank Mp(C^) = rp , then dimKer Mp{C^) T = 
0, and hence z p = (Ai /3 w / 3 )^ =1 = (0)^ =1 for /3 € S^y), a contradiction. In consequence, 

dim UsfcmpM 1 ?) = dimt/r n ( u v) = r P 

for 1 < ifi < and /? € S(p.). Hence f/“ ln (v) = C/™ m (u^) holds for 1 < z M < r^ and /3 € S(/i). ■ 
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3 Geometric structures for TBF tensors 


Before characterising the ’’local coordinates” of a tensor v £ .P7” r (V d) we need to introduce the Banach- 
Grassmann manifold and its relatives. 

3.1 The Grassmann-Banach manifold and its relatives 

In the following, X is a Banach space with norm ||-||. The dual norm || •llx. of A'* is 

IMIx* = sup{|v?(a;)| : x £ X with ||x|| x < 1} = sup{|<p(a:)| / ||a:|| x X} . (3.1) 

By C(X, Y ) we denote the space of continuous linear mappings from X into Y. The corresponding operator 
norm is written as |H|y^_x • 

Definition 3.1 Let X be a Banach space. We say that P £ C{X, X) is a projection if P o P = P. In this 
situation we also say that P is a projection from X onto P( X) := ImP parallel to KerP. 

From now on, we will denote P o P = P 2 . Observe that if P is a projection then lx — P is also a 
projection. Moreover, lx — P is parallel to Im P. 

Observe that each projection gives rise to a pair of closed subspaces, namely U = ImP and V = KerP 
such that X = U ® V. It allows us to introduce the following two definitions. 

Definition 3.2 We will say that a subspace U of a Banach space X is a complemented subspace if U is 
closed and there exists V in X such that X = U © V and V is also a closed subspace of X. This subspace V 
is called a (topological) complement of U and (U,V) is a pair of complementary subspaces. 

Corresponding to each pair (U, V ) of complementary subspaces, there is a projection P mapping X onto 
U along V, defined as follows. Since for each x there exists a unique decomposition x = u-\- v, where u £ U 

and v £ V. we can define a linear map P(u + v) := u, where ImP = U and KerP = V. Moreover, P 2 = P. 

Definition 3.3 The Grassmann manifold of a Banach space X , denoted by G(A), is the set of all comple¬ 
mented subspaces of X. 

U G G(A) holds if and only if U is a closed subspace and there exists a closed subspace V in X such 
that A' = U © V. Observe that X and {0} are in G(A). Moreover, by the proof of Proposition 4.2 of [TO], 
the following result can be shown. 

Proposition 3.4 Let X be a Banach space. The following conditions are equivalent: 

(a) U £ G(A). 

(b) There exists P G C{X,X) such that P 2 = P and ImP = U. 

(c) There exists Q G C{ A, A) such that Q 2 = Q and KerQ = U. 

Moreover, from Theorem 4.5 in uni, the following result can be shown. 

Proposition 3.5 Let X be a Banach space. Then every finite-dimensional subspace U belongs to G(A). 

Let V and U be closed subspaces of a Banach space A' such that X = U © V. From now on, we will denote 
by P U9V the projection onto U along V. Then we have P VS)U = lx — P, ;fflV • Let U, U' G G(A). We say that 
U and U' have a common complementary subspace in X, if X = U © W = U' ®W for some W G G(A'). 
The following result will be useful (see Lemma 2.1 in ED- 

Lemma 3.6 Let X be a Banach space and assume that W, U, and U' are in G(A). Then the following 
statements are equivalent: 

(a) X = U ®W = U' © W, i.e., U and U' have a common complement in X. 
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(b) P U9W \u' '■ U' U has an inverse. 

Furthermore, if Q = {P U9W \ V ,) 1 , then Q is bounded and Q = P u , @w \ u - 
Next, we recall the definition of a Banach manifold. 

Definition 3.7 Let M be a set. An atlas of class C p (p >0) on M is a family of charts with some indexing 
set A, namely {( M a ,u a ) : a £ A}, having the following properties: 

ATI {M a } a £A is a covering of M, that is, M a C M for all a € A and U a ^AXI a = M. 

AT2 For each a £ A, (M a , u a ) stands for a bijection u a : M a —> U a of M a onto an open set U a of a Banach 
space X a , and for any a and fj the set u a (M a D Mp) is open in X a . 

AT3 Finally, if we let M a C\Mp = M a p and u a (M a p) = U a p, the transition mapping upoujj 1 : U a p —>• Up a 
is a C p -diffeomorphism. 

Since different atlases can give the same manifold, we say that two atlases are compatible if each chart of 
one atlas is compatible with the charts of the other atlas in the sense of AT3. One verifies that the relation 
of compatibility between atlases is an equivalence relation. 

Definition 3.8 A n equivalence class of atlases of class C p onM is said to define a structure of a C p -Banach 
manifold on M, and hence we say that M is a Banach manifold. In a similar way, if an equivalence class 
of atlases is given by analytic maps, then we say that M is an analytic Banach manifold. If X a is a Hilbert 
space for all a £ A, then we say that M is a Hilbert manifold. 

In condition AT2 we do not require that the Banach spaces are the same for all indices a, or even that 
they are isomorphic. If X a is linearly isomorphic to some Banach space X for all a , we have the following 
definition. 

Definition 3.9 Let M be a set and X be a Banach space. We say that M is a C p Banach manifold modelled 
on X if there exists an atlas of class C p over M with X a linearly isomorphic to X for all a £ A. 

Example 3.10 Every Banach space is a Banach manifold modelled on itself (for a Banach space Y, simply 
take ( Y,Iy ) as atlas, where Iy is the identity map on Y). In particular, the set of all bounded linear maps 
C(X,X) of a Banach space X is also a Banach manifold modelled on itself. 

If X is a Banach space, then the set of all bounded linear automorphisms of X will be denoted by 

GL(A') := {A £ C(X,X) : A invertible } . 

Example 3.11 If X is a Banach space, then GL(X) is a Banach manifold modelled on £( X,X), because 
it is an open set in C(X,X). Moreover, the map A t— A~ l is analytic (see 2.1 in \32f ). 

The next example is a Banach manifold not modelled on a particular Banach space. 

Example 3.12 (Grassmann—Banach manifold) Let X be a Banach space. Then, following m (see also 
mj and l Wf), it is possible to construct an atlas for G(A”). To do this, denote one of the complements of 
U £ G(A) by W, i.e., X = U © W. Then we define the Banach Grassmannian of U relative to W by 

&(W, X) := {V £ G(X) : X = V © W} . 

By using Lemma \3.6\ it is possible to introduce a bijection 

* U(BW :G(W,X)-^jr(U,W) 


defined by 


’I ’u®w{U') = Pw®u\u> ° Pu'@w\u = Pw®u\u> ° {Pu®w\u>Y 


3 The condition of an open covering is not needed, see 1231 . 
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It can be shown that the inverse 

*d\>w-W,W)-^G{W,X), 

is given by 

= G(L) := {u + L(u) : u & U} . 

Observe that G(0) = U and G(L) © W = X for all L G C(U,W). Now, to prove that this manifold is 
analytic we need to describe the overlap maps. To explain the behaviour of one overlap map, assume that 
X = U(BW = U'(B W' and the existence of U" G G (W, X) n G (W 7 , X). Let L G C{U, W) be such that 

U" = G(L) = *ul w (L). 

and then 

X = U @W = U' ®W' = G(L) eW = G(L ) © W'. 

Since (id + L) is a linear isomorphism from U to U" = G(L) then T := Pu'®w’ ° (id + L) is a linear 
isomorphism from U to U'. It follows that the map ('S>u'®W' ° ^u®w) '■ G(U,W) C(U',W') given by 

(^u'®w oV I ’u®w)( L ) = ^ u'®w(G(L)) = Pw®u'\g(l) ° (-Pg'©w'|g(l)) _1 

= ^u’®w ( G(L )) = Pw®u'\g(l) ° Pg(l)®w\u' oT oT~ 1 
= Pw®u'\g{l) ° Pg(l)®w'\u' ° Pu'®w ° (id + L) o T~ l 
= Pw'®U' ° (id + L) o (Pu'®w 0 (id + L))~ 1 . 

is analytic. Then we say that the collection {'I'u'eVKj G(W, is an analytic atlas, and therefore, 

'I 'U@W 

G(X) is an analytic Banach manifold. In particular, for each U G G(X) the set G (W,X) = C(U,W) is 

a Banach manifold modelled on C(U,W). Observe that if U and U' are finite-dimensional subspaces of X 
such that dim U ^ dim U' and X = U®W = U'® W', then C(U, W) is not linearly isomorphic to C(U ', W'). 

Example 3.13 Let X be a Banach space. From Provosition \3 . 51 every finite-dimensional subspace belongs 
to G(X). It allows to introduce G„(X), the space of all n-dimensional subspaces of X (n > 0). It can be 
shown (see W) that G n (X) is a connected component of G(X), and hence it is also a Banach manifold 
modelled on C(U , W), here U G G„(X) and X = U © W. Moreover, 

G< r (X) := G n (X) 

n<r 

is also a Banach manifold for each fixed r < oo. 

The next example introduce the Banacli-Grassmannian manifold for a normed (non-Banach) space. To 
the authors knowledge there are not references in the literature about this (nontrivial) Banach manifold 
structure. We need the following lemma. 

Lemma 3.14 Assume that (X, || • ||) is a normed space and let X be the Banach space obtained as the 
completion of X. Let U G G n (X) be such that U C X and X = U © W for some W G G(A”). Then every 
subspace U' G G (W,X) is a subspace of X, that is, U' C X. 

Proof. First at all observe that X = U © (W fl X) where W fl X is a linear subspace dense in W = W fl X. 
Assume that the lemma is not true. Then there exists U' G G(W, A') such that U'®W = X and TJ'C\X ^ U'. 
Clearly U' fl X ^ {0}, otherwise W fl X = X a contradiction. We have X = (U' fl A) © (W fl A), which 
implies A = (U 1 fl A) © W, a contradiction and the lemma follows. ■ 

Example 3.15 Assume that (A, || • ||) is a normed space and let X be the Banach space obtained as the 
completion of X. We define the set G n (X) as follows. We say that U G G„(A) if and only if U G G„(A) 
and U C A. Then G„(A) is also a Banach manifold. To see this observe that, by Lemma \3.14\ for each 
U G & n (X) such that X = U ffi W for some W G G(X), we have G(W, A) C G ra (X). Then the collection 
{'I't/OWGG(W, X)} UeC ,t X ) is an analytic atlas on G„(A), and therefore, G„(X) is an analytic Banach 
manifold modelled on C(U,W), here U G G n (X) and X = U ffi W. Moreover, as in Examvle 1 3.131 we can 
define a Banach manifold G< r (X) for each fixed r < oo. 
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Let M be a Banach manifold of class C p , p > 1. Let m be a point of M. We consider triples (U,ip,v) 
where (U, p) is a chart at to and v is an element of the vector space in which p(U) lies. We say that two of 
such triples (U,p,v) and are equivalent if the derivative of at p{m) maps v on w. Thanks to 

the chain rule it is an equivalence relation. An equivalence class of such triples is called a tangent vector of 
M at to. 


Definition 3.16 The set of such tangent vectors is called the tangent space of M at m and it is denoted by 
T m (M). 

Each chart (U,p) determines a bijection of T m (M) on a Banach space, namely the equivalence class 
of (U,p,v) corresponds to the vector v. By means of such a bijection it is possible to equip T m (M) with 
the structure of a topological vector space given by the chart, and it is immediate that this structure is 
independent of the selected chart. 


Example 3.17 If X is a Banach space, then T X (A') = X for all x £ X. 

Example 3.18 Let X be a Banach space and take A £ GL(X). Then T J 4 (GL(A)) = C(X, X). 

Example 3.19 For U £ G(X) such that X = U ® W for some W £ G(X), we have Ty(G(X)) = C(U, W ). 

Example 3.20 We point out that for a Hilbert space X with associated inner product (•, •} and norm || • ||, 
its unit sphere denoted by 

§x := {a; G X : ||x|| = 1}, 

is a Hilbert manifold of codimension one. Moreover, for each x £ , its tangent space is 

Xe(§a') = spanja;} -1 = {x' £ X : (x,x r ) = 0}. 


3.2 The manifold of TBF tensors of fixed TB rank 

Assume that {V ( ,} a€ 'r , D \{D} is a representation of the tensor space = a V Q in the tree-based 

format where for each k £ C(Tr>) the vector space 14 is a norrned space with a norm || • ||fc. As usual 14 |M| 
denotes the corresponding Banach space obtained from 14 for k £ C(Td). From now on, to simplify the 
notation, we introduce for an admissible r £ N Td the product vector space 

R r := X R r “ x ( x /3es(°) r /3) ; 

aG T D \C(T D ) 

with 7 \d = 1. It allows us to introduce its open subset RJ, and hence a manifold, defined as 

x . c4°) e R* X “ es(D,r “and Cifo £ 

for each p £ Tjj \ {D} such that S(p) ^ 0. 



From Theorem 12.191 we know that each v £ TT X ^Sd) is totally characterised by £ = £(v) £ RJ and a 
basis : 1 < ifc < rfe} of G™ ln (v) for k £ C(To). Recall that in Example 13.151 the finite-dimensional 
subspace Uff ln (v) C 14 C 14 N M fc belongs to the Banach manifold G rfc (14) for k £ C(Td) (see also Example 
13.131) and for each k £ £(Tr>), there exists a bijection (local chart) 

^r (v) ®H7” (v) ; G(M4 min (v), v fc|M j £(t/r n (v),wr n (v)) 

given by 

T c/ m i n(v) 0 M /min( v )( 17 fc) = I/fc := P W jnin ( v )0[jmin ( v ) | U k ° {PlJ™ in (v)®W^ in ( V ) I U k ) 

Moreover, Uk = G(Lk) = spanjii^ + Lk{uk) : Uk £ £/™ ln (v)}. Clearly, the map 


: 


x G(w fc min (v),v fe|l . llfc ) -»■ x £(c/r n (v),wr n (v)), 

k£C{T D ) k£C(T D ) 
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defined as tl/v := X kec(T D ) 'V(/ min (v)ew' min (v) is also bijective. Furthermore, it is a local chart for an element 
il(v) = {b f ™ ln (v)} fcg £( TD ) in the product manifold such that $ v (il(v)) = o := (0 ) k ^c{r D )- It allows us to 
introduce the surjective map 

g x :TT x (V D )-> X Gr^Vj) 

3&C(T D ) 

defined by p r (v) = il(v) : = (U™ ln (v))k£C(T D )- Now, for each v G TT x {y d) introduce the set 


W(v) := pX X G(W“ in (v), Vj) = {w G TT X (W D ) : C/ fc min (w) G G(WT n (v), V k ), 1 < k < d} . 


\j£C(T D ) / 

Our next step is to construct the following natural bijection. Let 


X„(v) : U{v) 


X G{W^ in {v),Vj) xR'„ wg ( xi ( v )( w ), x 2 ( v )( w )) 


\jec(T D ) / 

defined as follows. Let w G U{v). From Theorem 12. 191 we have the following. 

(a) There exists a basis of 17™ ln (w) G G(W™ m (v), T4 |( . ||fc ), for each k G £(Td) and hence a unique 

£ = ( L k ) kGC ( TD) G X C(ur 1 (v), wf a M) 

keC(T D ) 

such that \I/ V (p r (w)) = £, that is, £/™ ln (w) = G(L k ) for all k G C(Td)- Then Xi( v )( w ) := and 

U™ ln ( w ) = G{L k ) = span {(idfe + L k ){uf^) : 1 < i k < r k } where f7™ m (v) = spanju^ : 1 < i k < r k } 
is a fixed basis for k G £(Td) and hence ’4 , v (er(v)) = (0 )keC(T D )- 


(b) There exists a unique x 2 ( v )( w ) ■= £ = (C'l“l) ag 'r D \£(T D ) € R* such that 


= y c< D \ 

(*o)oES(D) 


» 


(3.2) 


1 <i a <r a 
ocGS(D) 


aeS(D) 


and where for each /3 G To \ ({£)} U C{Tu)) we have 

t/™ m (w) = span(w,^ : 1 < ip < rp} 


with 


{idp + L p ){ufh 


if /? G C(T d ) 


w<« = 


® SeS03) w, ( f otherwise. 


Finally, let 


p v : X G(Wf in (v),^) xRX X G(Wj nin (v), Vj) 

\j£C(T D ) ) j£C(T D ) 

be the projection p v (ii , £) = it then p v o Xr( v ) = Q x - 

A very useful remark is the following. Recall that ( id k + L k ) is a linear isomorphism from t/™ ln (v) to 
Up*(w) = G(L k ) for all k G £(Tb). From Proposition 3.49 of [TH] we have 


£(Uf n (v),Uf n ( w)) =£ 




(v) 


u k ua 


(w) 


k€C(T D ) 


k£C(T D ) 


k&C(T D ) 
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and denote by GL 0fee£(T D ) 4“ ln (v) > a ®fcg£(T D ) 4™ ln (w)) the set of linear isomorphisms of 


C\ a 0 t4 mi » , a 0 C/r n (w) 
keC(T D ) kGC(T D ) 


Let us define 


GL I „ 0 t/ fe min (v) , a 0 i 

keC(T D ) k<EC(T D ) 


Then 


(idk + Lk) G GLi a 


GLi 

\ 

a 0 

V k£C(T D ) 
/ 

4f n (v) 

(w) j 

nM< i 

a 0 

keC(T D ) 

0 

t/r n ( V ) 

! a 0 


,a 0 tT(w) 
fce£(T D ) 

£(C/f n (v),C/f n (w)) 


f/ fc min (w) 


fee£(T D ) 


k&C(T D ) 


k£C(T D ) 


Observe that for each given v G FT X (V £>) the map 


e v : X G(VL min (v), y,o Xix x £(£4 min (v), ^r in (v)) X MI 


\jeC(r D ) 

where O v := x id is a bijection. Then 


\j&C(T D ) 


6 V o xt(v) : W(v) -> X C(Uf n (v), Wf in (v)) x : 

\j£C(T D ) J 

is also a bijection where 

(6v °Xr(v)) _1 (£, <£) = w = I 0 (id k + L k ) J (u) = I 0 (idk + Lk) | (0 V o Xt(v)) _1 (o, £). 

\keC(T D ) J \k£C(T D ) 

We can interpret this last equality as follows, w G lily) holds if and only if 


w G TT X 


(idk + Lk) 


ur\' 


K keC(T D ) 


kdC(T D ) 


for some £ G X keC(T D ) L{U^ ln (\r), Vy™ ln (v)). In consequence, each neighbourhood of v in J-T t (V d) can 
be written as 


W(v)= |J FT x I I 0 (*4 + 4)1 L 0 Ur n (v) 

£6 Xfce/:(T D) £(G” in (v),WX min (v)) \\k£C(T D ) J \ k&C(T D ) 

that is, a union of copies of TT X ( « ®k£C(T D ) ) indexed by a Banach manifold. Before stating the next 
result, we introduce the following definition. 

Definition 3.21 Let X and Y be two Banach manifolds. Let F : X Y be a map. We shall say that F is 
a C r (respectively, analytic) morphism if given x G X there exists a chart (U,Lp) at x and a chart (W,ip) at 
F(x) such that F(U ) C W, and the map 

%p o F o tp- 1 : ip(U) ip(W) 

is a C r -Frechet differentiable (respectively, analytic) map. 
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Lemma 3.22 Let v,v' G dFT x {y d) be such thatU(y ) flW(v') ^ 0. Then the bijective map 

Xr(v') O Xr(v)- 1 : ( x G (W7 in (v), Vj) ] XRJ4 X G(W J min (v'), Vj) J X MI 

\j&C(To) ) \j££(T D ) ) 

is an analytic morphism. Furthermore, it is an analytic diffeomorphism. 

Proof. Let v, v' G J 7 T X ('Vd ) be given. To prove the lemma we need to check that the map 
©v' o XtX) o Xr(v) -1 o 0” 1 : X W”(v),Wf(v))xl :-»■ X r(C/f n (v'),^r n (v'))xMI 

keC(T D ) k€C(T D ) 

is analytic whenever U(y) flM(v') 0. Let w G ZL(v) n U(V) be such that (Xr( v ) ° © v )(w) = (£, £) and 
(Xr(v') o 0 v /)(w) = (£', ID), that is, 


(©v' o Xr(v') O X r(v ) —1 O <£) = (£', D). 


Since w G ZL(v) nW(v') then 


and 
that is, 
Hence 


0r(w) = (C/f n (w)) fce£(TD ) G X G(H7 in (v),H,) n X G(H7 in (v'),H,') 

\jeC(T D ) ) \j£C(T D ) J 


(vk v , o d/-^)(vi/ v ((Gr n (w)) fee£ (T D ))) = ^(t/r n (w)) fee£(TD) ), 


($ v< o$; 1 )(£) = £'. 


(©v' °Xt(v'))(w) = ((^V' O^ 1 )^),®), 

where 4V o vk” 1 is an analytic map. Let u = (x't(v)” 1 o 0“ 1 )(o,£) and u' = (XtX -1 ° ©y)(o,I)). Then 
u e a®fee£(T D ) G™ m (v) , u' G a &)k£C(T D ) Uff in (v') and 


w = (0 V ° Xt(v)) 1 (£, £) = | 0 ( id k + L k ) I (u) = I 0 (td k + L k ) | o (0 V o Xr(v)) 1 (o, £) 

K kdC(T D ) ) \k£C(T D ) 


\-l 


= (0V' O Xr(v')) 1 (£',£>)= [ 0 (idk + L' k ) J (u') = I 0 (id k + L' k ) ) o(0 v , OXt(v')) ^O,®). 

K k&C(T D ) ) \fce£(T D ) 


Hence, 


(o, 35) = (0 V / o Xt(v')) 0 | 0 (id k + L' k ) 1 o (id k + L k ) j o (0 V o Xr(v)) 1 (o,£). 

yk£C(T D ) 


In consequence, we can write 


(o,D) = /(£,£):= (0v' °Xt(v')) ° | 0 ( idk+L'k ) 1 o (id k + L k ) | o (0 V o Xr(v)) 1 (o,£). 

y keC(T D ) 

and the map 

/: x £(t/ fc min (v),irr n (v)) xr;->{o}xr; 

kdC(T D ) 

is an analytic morphism. Thus the lemma is proved. 


The next result will help us to show that the collection {0 V o Xr( v ),^( v )}veJ r r t (v D ) is an atlas for 
FT X (V D ). Indeed, it is the unique manifold structure for which g x : FT x (y d) —> X j^c(T D ) G rj (Vj) defines 
a locally trivial fibre bundle with typical fibre K-I. To this end we will use Lemma 13.221 and the following 
classical result (see Proposition 3.4.28 in [55]). 
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Theorem 3.23 Let E be a set, B and F be C k manifolds, and let n : E —>• B be a surjective map. Assume 
that 

(a) there is a C k atlas {(U a ,ip a ) : a £ 1} of B and a family of bijective maps Xa '■ 7r _1 (I7 a ) —> U a x F 

satisfying p a ° Xa = tt, where p a : U a x F —>• U a is the projection, and that 

(b) the maps Xa’ ° XfY : U a x F —» U a > x F are C k diffeomorphisms whenever U a n U a ' yf 0. 

Then there is a C k atlas {(Vp,i(> a ) : f3 £ J} of F and a unique C k manifold structure on E given by 

{{Xa 1( K U a X Vs), (p a X ifp)) O Xa ■ a £ I, j3 £ J} 

for which n : E —>• B is a C k locally trivial fibre bundle with typical fibre F. 

Let us mention the following two mathematical objects related to the above theorem. Let B and F be C k 
manifolds, and let n : E —> B be a surjective map satisfying the conditions (a)-(b) of Theorem 13.231 Then 
(. E , B , 7 r) is called a fibre bundle with typical fibre F, and if F is also a Banach space, then it is called a 
vector bundle (see Chapters 6 and 7 in [B|). In consequence, we can state the following result. 

Theorem 3.24 Assume that {V Q } agTD \{£)} is a representation of the tensor space = a ® a eS(D) 

in the tree-based format where for each k £ £(Tb) the vector space 14 is a normed space with a norm |j ■ ||fc. 

Then the collection {0 V ° Xt( v ),^( v )}veJ r Tc(V D ) is an analytic atlas for FT x (Vd)- Furthermore, the set 
FT~x(y d) of TBF tensors with fixed TB rank is an analytic Banach manifold and 


JTx(Vd), X G r ,(V*),0r 

V. jec(r D ) / 


is a fibre bundle with typical fibre R*. 

Proof. Take the set E = FT t (V d) and the analytic Banach manifolds B = 'X j£C(r D ) and F = R*. 

Let us consider the surjective map g t : FT t {V d) —> X j^c(T D ) (Vj). The theorem follows from The¬ 
orem [3231 because Theorem I3.23f al is true by the definition of ,\ r (v) and Theorem I3.23f b! is a consequence 
of Lemma 13.221 ■ 

Remark 3.25 We observe that the geometric structure of manifold is independent of the choice of the norm 
|| • ||d over the tensor space 'Vo- 

Corollary 3.26 Assume that Vfc |M| is a Hilbert space with norm || • ||fc for k £ C{To). Then FT X (Vo) is 
an analytic Hilbert manifold. 

Proof. We can identify each Lk £ C (t/™ ln (v), W™ ln (v)) with a £ W™ ln (v) rfe , where = 

Lk(u k Sk j) and £7™ ln (v) = spanjuj^,..., uj^} for k £ C(To). Thus we can identify each (£, <£.) £ U(v) with 
a pair 

m,c)£ x w k min (vr x ri, 

kaC(T D ) 

where 2H := ((wi^‘![‘)i e £(r ]) ). Take X keC{T D ) W™ m (v) r,t x R* an open subset of the Hilbert space 
Xfce£(T D ) W™ n (v) T ' fe x R r endowed with the product norm 

r k 

|| (20, C) || x := Y, + E Ellw^lU, 

a&T D \C(T D ) kdC(T D )s k =1 

with || • ||jr the Frobenius norm. It allows us to define local charts, also denoted by 0 V o y r (v), by 

Xr _ 1 (v) o 04 1 : X WX m XY k xi;-> W(v), 

k£C(T D ) 
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where (x r : (v) o Q v 1 ) (2U, £) = w putting Lk( u-^) = w-^, 1 < 4 < rk and k £ £(Td). Since each local 
chart is defined over an open subset of the Hilbert space X keC(T D ) W™ m (v) rk x R r , the corollary follows. ■ 

Using the geometric structure of local charts for the manifold FT X (V c),we can identify its tangent space 
at v with T v (J 7 T t (V£))) := X fcg£ ( TD ) £(t/™ m (v), fU“ ln (v)) x R r . We will consider T v (TT x (y d)) endowed 
with the product norm 

1111(^)^)1111 := II^’ ( "'IIf+ ^2 l|ife|lw“ ln (v)<-c/“ in (v)- 

a&T D \C(T D ) k£C(T D ) 

Moreover, the map g x is an analytic morphism and 

T v0r : X U(t/ fc min (v),tur n (v)) xl '4 X A^r(v).^r(v)), (£,£)-►£. 

kGC(T D ) k<EC(T D ) 


Finally, the same argument used to provide a Banach manifold structure to the set G< n (X) used with 
XT< x {V d ) and (12.51) . allows us to state the following. 

Theorem 3.27 Assume that {V a } a 6 T D \{j 3 } is a representation of the tensor space = o® a eS(fl) V Q 
in the tree-based format where for each k £ C(Td) the vector space 14 is a normed space with a norm || • ||fc. 
Then the set J~T< x (fV d) of TBF tensors with bounded TB rank is an analytic Banach (Hilbert) manifold. 


4 The TBF tensors and its natural ambient tensor Banach space 

Assume that {V a }aeT D \{.D} is a representation of the tensor space = a <S) Q es(D) ^ i n the tree-based 
format and that for each k £ C(Td) the vector space 14 is a normed space with a norm || • [[*,. We start with 
a brief discussion about the choice of the ambient manifold for TT x (Vd)- To this end assume the existence 

of two norms || • Hup and || ■ ||d ,2 on V4>. Then we have Vd C Vd" ^ d ' 1 and Vd C Vc® " d ’ 2 . The next 
example illustrates this situation. 

Example 4.1 Let 14 |Hh := H^P{h) and U 2|Ml2 = H^h). Take V D := H^h) ® Q iT’ p (/ 2 ). From 
Theorem \3.24\ we obtain that J-1 ~ X (Vd) Is a Banach manifold. However, we can consider as ambient manifold 

either V D D|1 := H 1>p (Ii x I 2 ) or Vd" " r> ’ 2 = H 1,P (L i) ®||.|| (01)iJ) H 1 ’ P (I 2 ), where || • ||(o,i), P is the norm 
given by 

11/11(0,i)* “ (ll/ll? + 

for 1 < p < oo. 

In this context two questions about the choice of a norm || • || Q for each algebraic tensor space V a = 
a <S)p e S( a ) v /3 ) where a £T D \ C(T D ) appears: 

1. What is the good choice for these norms to show that HT< X ((Vd) is proximinal? 

2. What is the good choice for these norms to show that IFT X (Vd) is an immersed submanifold? 

To see this we need to introduce the topological tensor spaces in the tree-based format. 

4.1 Topological tensor spaces in the tree-based Format 

First, we recall the definition of some topological tensor spaces and we will give some examples. 


df_ 

dx 2 
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Definition 4.2 We say that V||.|| is a Banach tensor space if there exists an algebraic tensor space V and 
a norm ||-|| on V such that V||.|| is the completion ofV with respect to the norm ||• ||, i.e. 

d - i -n-n 

V IMI : = ll ll 0 V i = “ 0, =1 V > ' 

3=1 

If \||. is a Hilbert space, we say that V||.|| is a Hilbert tensor space. 

Next, we give some examples of Banach and Hilbert tensor spaces. 

Example 4.3 For Ij C R (1 < j < d) and 1 < p < oo, the Sobolev space H N,p (Ij) consists of all univariate 
functions f from L p (Ij) with bounded norr?0 


/ N r \ Vp 

H/lk P ;b : = E / \9 n f\ P dx) , 

'n=0"'b ' 

whereas the space H N,P ( I) of d-variate functions on I = I\ x I 2 x ... x Id C is endowed with the norm 

n/ik P : =( E /i3 n /i p dx) 1/p 

0<|n|<./V l/l 

with n £ Nq being a multi-index of length |n| := J2j=i n j■ F° r p > 1 it is well known that H N:P (Ij) and 
H N,P (I) are reflexive and separable Banach spaces. Moreover, for p = 2, the Sobolev spaces H N (Ij) := 
H N ' 2 (Ij) and H N (1) := H N,2 (1) are Hilbert spaces. As a first example, 

»"'’(!)= INI 

3 = 1 

is a Banach tensor space. Examples of Hilbert tensor spaces are 

d d 

L\l) = |H| 0 , a 0£ 2 &) and H N ( I) = Htf a (g) H n (Ij) for N £ N. 

3=1 3=1 

In the definition of a tensor Banach space ||.|| Vj we have not fixed, whether Vj, for j £ D , are 

complete or not. This leads us to introduce the following definition. 

Definition 4.4 Let D be a finite index set and To be a dimension partition tree. Let (Vj, || ■ ||j) be a 
normed space such that Vj- |M| . is a Banach space obtained as the completion ofVj, for j £ D, and consider 
a representation {V tt } a£ r D yB} of the tensor space V d = a b where for each a £ Tjj \ £{Td) we 

have a tensor space V Q = a &)fj£S(a) Xs • If for each a £ Tp \ C{Tu) there exists a norm || • || a defined 
on V a such that V tt|| ^ = ||.|| a <S>^eS( a ) h? * s a t ensor Banach space, we say that } a eT D \{£)} a, 

representation of the tensor Banach space V.d |H| = ||.|| D &) j^D Vj in the topological tree-based format. 

Since V a = a <S>j ea Vj , 

V-M. = ll'lla 0 = IHL0b 

aeS(D) j&a 

holds for all a £Td\ C(Td). 

Example 4.5 Figure \flf\ gives an example of a representation in the topological tree-based format for an 
anisotropic Sobolev space. 


4 It suffices to have in fra the terms n = 0 and n = N. The derivatives are to be understood as weak derivatives. 
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H n ’P(I 2 ) H n ’P(I 2 ) 


Figure 4.1: A representation in the topological tree-based format for the tensor Banach space 
- II • II 12S 

L p {Ii) ®a H N ’P(I 2 ) <8 >a H N ’P(I 3 ) . Here || • || 2 3 and || • || 123 are given norms. 



H N ’P(I 2 ) H N ' p (Ii) 


- IMlaT 11 ' 11123 

Figure 4.2: A representation for the tensor Banach space L p (1 1 ) ® a H N ’P(I 2 ) 8> a H N <p (I 3 ) , using a 

tree. Here || • ||23 and || ■ || 123 are given norms. 


Remark 4.6 Observe that a tree as given in Figure \J7S | is not included in the definition of the topological 
tree-based format. Moreover, for a tensor v £ L p (Ii) < 8 > a ( H N ’ P (I 2 ) 8>||.|| 23 H N ’ P (I 3 )), we have U £( m (v) C 
H N ' p {I 2 ) 8>||.|| 23 H n -p(I 3 ). However, in the topological tree-based representation of Figure \f.l\ for a given 
v £ LP{h) ® a H N ' p (I 2 ) ® a H N ’ p (I 3 ) we have Ug n (v) C H N *{I 2 ) H n >p(I 3 ), and hence Ug in (v) C 

t/ 2 min (v) <g> a f/ 3 min (v). 

The difference between the tensor spaces involved in Figure ITT! and Figure I4~21 is the following. For all 
/3 £ Tjj \ C(Td), if || • ||^3 is also a norm on the tensor space a ® ri ^s[p) > we have 

Ms 0 V »J||.||, D V /9||-ll^ = II-II/3 0 V v = Hu 0 v 3 ■ 

v£S{p) v£S(p) jep 

A desirable property for the tensor product is that if || ■ || a is also a norm on the tensor space a <S> 0 gs( a ) V %„, > 
then 

ll-lla 0 v / 3||.|| 3 = ll-IU 0 V ^ = IMU0 V ? ( 4 - 2 ) 

P eS(a) P^S(a) j£a 

must be true for all a £ To precise these ideas, we introduce the following definitions and results. 


Let || -|| •, 1 < j < d, be the norms of the vector spaces Vj appearing in V = a 0^ =1 Vj . By ||-|| we denote 
the norm on the tensor space V. Note that ||-|| is not determined by ||-|| •, for j £ D , but there are relations 

which are ‘reasonable’. Any norm ||-|| on a <S> 3 _i V) satisfying 



is called a crossnorm. As usual, the dual norm of ||-|| 
is a crossnorm on a 0 . =1 V* , i.e., 



then ||-|| is called a reasonable crossnorm. 


for all Vj £ Vj (1 < j < d) (4.3) 

is denoted by ||-||*. If ||-|| is a crossnorm and also ||-||* 

for all <p U) £ V* (1 <j<d), (4.4) 
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Remark 4.7 Eq. (14.31) implies the inequality |j i>j|| < J|y =1 Ikillj which is equivalent to the continuity 

of the multilinear tensor product mapping between normed spaces: 

0: X (VjMj) —► (a0V* ,||-|l)> (4.5) 

j'= 1 ' j =i ' 

defined by (ft) ((vi,, Vd)) = &>j=i v j> the product space being equipped with the product topology induced by 
the maximum norm ||(ui,..., Ud)|| = maxi<j<d ||uj||j. 


The following result is a consequence of Lemma 4.34 of m- 

Lemma 4.8 Let ( Vj , || ■ ||j) be normed spaces for l < j < d. Assume that || ■ || is a norm on the tensor space 
a i V jM such that the tensor product map 



is continuous. Then (TOl) is also continuous and 

d d 



3 =1 3=1 


holds. 


Definition 4.9 Assume that for each a £ Tjj\C(Tjj) there exists a norm || ■ || a defined on a &)pes(a) Vp\\ 

We will say that the tensor product map (^) is Tp-continuous if the map 

0: X 04 

P es(a) 

is continuous for each a £ Tjj \ C(Te>). 

The next result gives the conditions to have (14.21) . 

Theorem 4.10 Assume that we have a representation {V Q|| _ ||q } a gr D \{D} the topological tree-based format 
of the tensor Banach space ||c = ||.|| D (S) a es(D ) , such that for each a £ To \ C{Tu), the norm || • || a 

is also defined on a (£)g e g( a ) Vp\\.\\ p an d the tensor product map is Tp-continuous. Then 



V 


/^mi 


Vfl = 


)V 3 , 


p eS(a) PeS(a) 

holds for all a £ Tp \ C(Tr>). 

Proof. From Lemma 14.81 if the tensor product map 


j&a 


: x (v % , j-y-tu 


v fi 


■lip > ii ii pi ' v a yy J P\\ w P 
PeS(a) P^S(a) 


is continuous, then 


V 


011-II/s 


Vp 


/3eS(a) P&S(a) 

holds. Since V a = a <S>pes(a) V p = a ®j^ a Vj > the theorem follows. 


s Recall that a multilinear map T from X 7=1 {Vj. || ■ || 3 ) equipped with the product topology to a normed space (IV. 
continuous if and only if ||T|| < oo, with 


||T|| := sup |r(fi,...,f,;)ll - sup 

(■“1 .■“<*) (vi,...,v d ) 

II («!>■■■,«d)ll<! llrJl || 1 <1.I|u d lid <1 


||T(ui,...,u d )H = sup 


(vi ,... ,Vd) |M|l---|M|d 
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Example 4.11 Assume that the tensor product maps 

0 : || • || 0iP;/l ) x ®||.|| 23 H n *(I 3 ), || ■ || 23 ) -»■ (L p (/i) <8 0 (H n *(I 2 ) <8| H | 23 H N *(I 3 )), || ■ || m ) 

and 

0 = || • || Wa ) x (H n *{I 3 ), || • ||jv, p; / 3 ) -► (H n *(I 2 ) ® a H N *{I 3 ), || • || 23 ) 

are continuous. Then the trees of Figure M and Figure \4-2\ are the same. 

The next result is a consequence of the well-known fact that every continuous multilinear map between 
norrned spaces is also Frechet differentiable (see (2.1.22) in [5]). 

Proposition 4.12 Let (Vj, || ■ ||j) be norrned spaces for 1 < j < d. Assume that || ■ || is a norm onto the 
tensor space a <S>j-i Vi\\.\\ ■ sucb that the tensor product map (14.611 is continuous. Then it is also Frechet 
differentiable and its differential is given by 

d 

D ( 0 (^ 1 ,...,^)) (W! ,...,w d ) = E V\ <8 • • • <8 Vj -1 8 Wj 8 Vj +1 (8 • • • Vd- 

i =i 


4.1.1 On the best approximation in FT < t (V d) 

Now we discuss about the best approximation problem in FT < t (Vc). For this, we need a stronger condition 
than the To-continuity of the tensor product. Grothendieck m named the following norm ||-|| v the injective 
norm. 


Definition 4.13 Let Vi be a Banach space with norm || -1^ for 1 < i < d. Then for v 6 V = a ®j =i Vj 
define ||*II v( vi,...,v^) b V 


lv(Vi ,...,V d ) 


:= sup ■ 


|(y?i (8 v?2 <8 • • ■ <8 <Pd) (v)l 

nU iivbiL* 




(4.7) 


It is well known that the injective norm is a reasonable crossnorm (see Lemma 1.6 in m and (El-COD)- 
Further properties are given by the next proposition (see Lemma 4.96 and 4.2.4 in 119) 1. 


Proposition 4.14 Let Vi be a Banach space with norm ||for 1 < i < d, and || ■ || be a norm on V := 
a (S>j=i Vi ■ The following statements hold. 

(a) For each 1 < j < d introduce the tensor Banach space Xj := ||.|| v(Vi v . i v . +i Vd) Vk ■ Then 

II • j|v(Vi,...,v d ) = II • llv(y,- n Xj) (4.8) 


holds for 1 < j < d. 


(b) 


The injective norm is the weakest reasonable crossnorm on V, i.e., if ||- 
V, then 

INI ~ II' II V(Vi,...,Vd) 


is a reasonable crossnorm on 
(4.9) 


(c) For any norm ||-|| on V satisfying ||• II V (vi v d ) ~ INI > bhe map \4-5\) is continuous, and hence Frechet 

differentiable. 


In Corollary 4.4 in m the following result, which is re-stated here using the notations of the present 
paper, is proved as a consequence of a similar result showed for tensors in Tucker format with bounded rank. 


Theorem 4.15 Let Vd = a ® je£) Vj an d let {V aj . || ||a : 2 < j < d} U {Py M || . : 1 < j < d} for d> 3, be a 

representation of a reflexive Banach tensor space ||d = ||.|| D (££) ;g£3 Vj , in topological tree-based format 
such that 
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(a) IMI^^MIv(v 1| , || .,...,y (i|| . ||d ), 

(b) v ad = Vd -1 ®a Vd, and V aj = Vj -i ® Q V aj+1 , for 2 < j < d - 1, and 

(c) || • || a .- := || • || V (vq i v d ) for 2 < j < d. 

\ / ii ii I'i u-llj-i ’ ’ d ll-ll d J ~ J ~ 

Then for each v € Von ||d there exists u best G J~T<t(V d) such that 

IIv - u best ||D = min ||v-u||i> 

ug ^r< t (v D ) 

It seems clear that tensor Banach spaces as we show in Example 14.21 are not included in this framework. 
So a natural question is if for a representation in the topological tree-based format of a reflexive Banach 
space the statement of Theorem 14.151 is also true. To prove this, we will reformulate some of the results 
given in HJ. In the aforementioned paper, the milestone to prove the existence of a best approximation is 
the extension of the definition of minimal subspace for tensors v G V.d |M| \ V^. To do this the authors use 
a similar result to the following lemma (see Lemma 3.8 in ED- 

Lemma 4.16 Let M be a Banach space for j G D , where D is a finite index set, and a±,... ,a m C 

2 D \ { D , 0}, be such that ai fl aj =0 for all i ^ j and D = [J™_ 1 aii. Assume that if ffoti > 2 for some 
1 < i < m, then V Qi is a tensor Banach space. Consider the tensor space 


Vr, := „(g)V 

i= 1 


endowed with the injective norm || ■ II v(v N y .v 

the map id ak <g> <P[a k ] belongs to C ^V D ,V at 
norm satisfying 

II • II > II • llv(x 


"■W-WoJ' Fixl - k - m ' then given tp [ak] G „<8) j# V* ai|H 
. Moreover, id ak <g) ¥> [afc] G ^(Vd 1 N ’, V afc|| ) for any 

‘1 II" II a,! |M|„ m )' 


Let {V a| | || a }a£T D \{D} be a representation of the Banach tensor space Vd |H| = ||.|| D Vj ; i n the 

topological tree-based format and assume that the tensor product map {^) is Tb-continuous. From Theorem 
14.101 we may assume that we have a tensor Banach space 


v -..|. = INI- 0 
pes(a) 

for each a G Tjj \ £(Td), and a Banach space V) |M| . for j G £(Td). Let a G Tjj \ £(Td ). To simplify the 
notation we write for A, B C 5(a) 

II • llv(A) := II • Hv({v J|M|{ :«e4}), 

and 

II • llv(A,V(B)) := II • ||v({V, B . :i€A},XB) 

where 

X B : = IMIv(B) 0 V /3|MI 3 • 

/3e b 

From Proposition I4.14f al , we can write 

II ■ l|v(S(ce)) = II ' llv(/3,V(S(a)\/3)) 
for each /3 G 5(a). From now on, we assume that 


II ' ||a > II • ||v(S(ce)) for each a G Td \ £(T D ), 


(4.10) 
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holds. Recall that Proposition 14.1-ll c) implies that the tensor product map <g) is To-continuous. Since 
II ' IIa > II ' II v(/3,v(S(a)\/3)) holds for each /3 G S{a), the tensor product map 

0) ■ CV,, M , || ' II/?) X I ||■ II V ( S ( ce )\ / 3) 0) ’ II ' llv(S(a)\/3) I (V„ Ma , II • ||a) 

V <5eS(a)\{/3} ) 

is also continuous for each /3 € S(a). Moreover, by Theorem 14. 101 

V “iHtc« = ll-IU 0 v Pi-ip = ll-llo 0 V P = IHU0 y j > 

0 GS(a) PeS(a) jea 

holds for each a G To \ £(Td). Observe, that V*^ ^ C V* for all a G S{D). Take V d = a ® je£) Vj ■ Since 
II ' lie > II ' IIv(5( D))i from Lemma 14.161 and Proposition 12.lll bb we can extend for v G V.d |M| \Vd, the 
definition of minimal subspace for each a G S{D) as 


[/“ m (v) := <{ {id a <g> y [a] )(v) : ip [a] G a 0 V} 

0eS(D)\{ a } 


Observe that (id a ® <P[ a \) G £(Vd |H| , V a|| . ||a ). Recall that if v G and a from Proposition ^. 101 

we have t/“ m (v) C a <S>p e s(a) c « < S>0eS(a) v /3 ■ Moreover, by Proposition 12.lll bb for /? G S{a) 


we have 


C/r n W = span < {idp <g> <p^ )(v a ) : v a G /7“ m (v) and ip [fj] G 


VI 


ses( a )\{ 0 } 


= span {idp ® <p [/3] ) o (id a ® ¥> [a] )(v) : <p [a] G „ 0 V* and <p [f)] G Q 0 

li&S(D)\{ a } 5&S(a)\{0} 

Thus, (id a ® <P[ Q ])(v) G C4“ ln (v) C V a C V Q|| . ||a , and hence 

<g> ip m ) o (id a ® v? w )(v) g £/£"» cv^c v^ |hM , 


V| >. 


when#/3 > 2. However, ifv G V D|| ||d \V d then ( id a ® v? [a] )(v) G U™ ln {v) C V a|| ||Q . Since ||-||« > |Hlv(S(«)) 
also by Lemma 14.161 we have idp ® tp^ G £(V Q|| |1q , ^). In consequence, a natural extension of the 

definition of minimal subspace t/™ ln (v), for v G Vc |M| \Vb, is given by 


[/“ m (v) := span { {idp ® ip [f}] ) o ( id a ® <p [a] )(v) : ip [a] G 


To simplify the notation, we can write 


and ip [p] G 


v; 


fj.eS(D)\{a} 


ses( a )\{0} 


{idp <g> tp[p iCt] ){v) ■■= {idp ® tp m ) o {id a ® W])( v ) 

where tp\p, a ] ■= V\ a )®V[p] € (« ® /ie s(D)\{a} V m) ®a(o <S>8eS(c,)\{0} V |) and {idp ® tp^) G £(Vz> IMI d , V^). 
Proceeding inductively, from the root to the leaves, we define the minimal subspace [/““(v) for each 
j G jO{Td) such that there exists f| G To \ {£>} with j G S'( 77 ) as 


t/“ m (v) := span j(idj <g> ¥ 3 b> ) ..,^,a])( v ) : ( P[^,... >/ 3 ,a] e W^j 


where 


Wj := 


v; | ®„ | „ 0 vj|® a --.® a | a 0 v k * 


veS(D)\{ a } ) \ 5eS(a)\{/3} / \ keS(ri)\{j} 

With this extension the following result can be shown (see Lemma 3.13 in .11!). 
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Lemma 4.17 Let {V a|| ||q } a eT D \{£>} be a representation of the Banach tensor spaceW d IIIId = \\-\\d ® j^D^o > 
m f/ie topological tree-based format and assume that (14.1011 holds. Let {v^l^o C Vd |||d with v n —*■ v, and 
pi £ Tjj \ ({£>} U £(Td)). Then for each 7 £ S(p) we have 

(id-y ® ,P, a ])( v n) {idj ® Vfr,^... ,/3,a])( v ) in V 7|M| 7 . 

for all i( 9 ia ] e (a < 8 > AI eS(D)\{a} V m) ® a ( a ®5eS(a)\{p} V 5 ) ' ' ' ®a ( a ( 8 > ) ,sS(m)\{ 7 } ^ 7 * ) ’ 

Then in a similar way as Theorem 3.15 in m the following theorem can be shown. 

Theorem 4.18 Let {V a|| ||q } a gT D \{fl} be a representation of the Banach tensor spaceX D| MId = ||-||ri ®jeD Yi > 
in the topological tree-based format and assume that (14.101) holds. Let {v„} n >o C Vb |M| with v„ —*• v, then 

dimCf“ in (v) IMI “ = dimt/“ in (v) < liminf dimC/“ in (v„), 

n—too 


for all a £ Tjy \ {D}. 

Now, following the proof of Theorem 4.1 in mi we obtain the final theorem. 

Theorem 4.19 LetX d = a^ ie jjVj and let {V a|| ||q } a 6T D \{c} be a representation of a reflexive Banach 
tensor space V.d 1m| = ||.|| D (^)- G£) Vj , in the topological tree-based format and assume that (14.101) holds. 
Then the set FT < r (V fr) is weakly closed in Vd |N| and hence for each v £ Vd | m| there exists u best £ 
FT< x (Vd) such that 

||v - Uf, est ||_D = min ||v-u||r». 
u e^r< t (v D ) 

4.2 Is fFT t {y D ) an immersed submanifold? 

Assume that the tensor product map {^) is To-continuous and that we have a natural ambient space for 
FT x iy d) given by a Banach tensor space Vd^ = Vd (| . Since the natural inclusion 

i : TTxiy d) —> V D|m|d , 

given by i(v) = v, is an injective map we will study i as a function between Banach manifolds. To this end 
we recall the definition of an immersion between manifolds. 

Definition 4.20 Let F : X —> Y be a morphism between Banach manifolds and let x £ X. We shall say 
that F is an immersion at x, if there exists an open neighbourhood X x of x in X such that the restriction of 
F to X x induces an isomorphism from X x onto a submanifold of Y. We say that F is an immersion if it is 
an immersion at each point of X. 

Our next step is to recall the definition of the differential as a morphism which gives a linear map between 
the tangent spaces of the manifolds involved with the morphism. 

Definition 4.21 Let X and Y be two Banach manifolds. Let F : X —tY be a C r morphism, i.e., 

ip o F o p^ 1 : ip(U) —1 ip(W) 

is a C r -Frechet differentiable map, where (U,p) is a chart in X at x and ( W,ip ) is a chart in Y at F(x). 
For x £ X, we define 

T X F : T x (X) — * T f(x) (F), v ^ [(ip o F o p -1 )'(p(x))]v. 

For Banach manifolds we have the following criterion for immersions (see Theorem 3.5.7 in [IB]). 

Proposition 4.22 Let X, Y be Banach manifolds of class C p (p > 1). Let F : X —> Y be a C p morphism 
and x £ X. Then F is an immersion at x if and only ifT x F is injective and T x F(Tj;(X)) £ G(Tp’( x )(T)). 
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A concept related to an immersion between Banach manifolds is the following definition. 


Definition 4.23 Assume that X and Y are Banach manifolds and let / : X —> Y be a C r morphism. If f 
is an injective immersion, then f(X) is called an immersed submanifold of Y. 

Recall that there exists injective immersions which are not isomorphisms onto manifolds. It allows us to 
introduce the following definition. 

Definition 4.24 An injective immersion f : X —> Y which is a homeomorphism onto f(X) with the 
relative topology induced from Y is called an embedding. Moreover, if f : X —> Y is an embedding, then 
f{X) is called an embedded submanifold of Y. 

A classical example of an immersed submanifold which is not an embedded submanifold is given by the 
map / : (37 t/4 , 7n/A) — > R 2 , written in polar coordinates by r = cos 2 9. It can be see that / is an injective 
immersion however /( 3tt/A, 7n/A) is not an open set in R 2 , because any neighbourhood of 0 in R 2 intersects 
/(37 t/4 , 7tt/A) in a set with ’’corners” which is not homeomorphic to an open interval (see Figure l4~3ll . Before 
to give an example with tensors we need the following lemma. 

Lemma 4.25 For each a £ Td\{D}, the set £(/7™ ln (v), IF™ ln (v)) is a complemented subspace o/£(V a|| „ , V a 
Hence for each v£ Vd and f3 ^ £(Td) the set X a£ g(m £(t/™ ln (v), IF” lln (v))) is a complemented subspace 
of the Banach space X a eS(/3) £( V ai||.|| a , Va IM | a )- 

Proof. Observe that the map 

n « ’ ^ F a H« > V «IH|J ~^ 

defined by 

H a (L a ) = P^min^Qjymm^LaPj/min^Q^min^) 

is a projection onto £([/™ ln (v), W™ ln (v)). ■ 


Example 4.26 Consider the morphism 

f:U(v)<zrr t (V D )—> x £(b a , |o ,b a|H JxR r 

adC(T D ) 

defined locally for each v £ PT r (V d) by /(w) = (O v °Xt( v ))( w ) = (£,<£)■ Then in local coordinates we 
have that f is the identity map. Clearly, f is injective and 

T v /( X £(P” in (v),IF“ in (v)) xR')= X £(U™ in (v),W™ in (v))x R*. 

ol£C(Td) cx.€lC{Td) 

From Lemma \4-25\ we have that 

X AC n W,C"(v))eG( X C(v ai . la ,v aM J) 

ol^C{Td) ol€lC(Td) 

and hence 

X £(P“ in (v),IF Q min (v)) xR'eG( X ^a Hal K, Ho )xR'). 

o.€lC(Td) aGjC(Tn) 

Then by Proposition \4-22\ f is an immersion. Moreover, f(JA(v)) with the topology induced by 

X £(Va l . l .,V. M .)xR t 

a&C(T D ) 

is homeomorphic to ll(y) when we consider in lA(y) the initial topology induced by f. We point out that we 
can consider {U(y) : v £ 7FT x (jV d)} as a, basis for a topology in TFT-cfV d)- Then, f is an embedding and 
/(PTr(Vu)) is an embedded submanifold of X a eC(T D ) £(V a|| ||a , V a|| „ ) x M r . 
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Figure 4.3: The set /( 37 r/ 4 , 77 t/4 ) in R 2 . The ”o” means that the lines approach without touch. 


From the above example we have that even the manifold TT X {V d) is a subset of Vd| M | d its geomet¬ 
ric structure is fully compatible with the topology of the Banach space X a ^s(0) £(V Q|| . ||q , V Q|| ) x R r . 
Moreover, it is not difficult to see that the same argument runs for the manifold TT< X (Vd)- 

In consequence, to prove that the standard inclusion map i is an immersion we shall prove, under the 
appropriate conditions, that if i is a differentiable morphism then for each v £ TT X (V d) the linear map T v i 
is injective and T v i(’T v (.7 r Tt(V£>))) belongs to G(V£> |m|d ). 


4.2.1 The derivative as a morphism of the standard inclusion map 

To describe i as a morphism, we proceed as follows. Given v £ FT x (Vd), we consider U(v), a local 
neighbourhood of v, and then 


(i ° ©v 1 ° X t 1 ( v )) 


X £(cc in (v), w a min (v)) X r; -»■ V| M|d 

a&C(T D ) 


is given by 


( 


\ 


(£, c) 


1 <ik< r k 
k£C(T D ) 


E 

l<i a <r a 
c,GT d \{D} 
\ <*<£C(T D ) 


c\ D \ 


n 


V>(*/3)/3 es(<x) 


/UE Td\{D} 


0 (E fc) +^(E fe) ))- 

keC(T D ) 


that is, 


(ioe^oyXW)^^) 


= w = 


E 

l<i Q <r Q 
aeS(D) 


C ( D \ 

(>o)aeS(D) 



aeS(D) 


where for each /j, € Td\{D} we write 

(id + L^i u^) 


(/x) 

w;' = 


P 


(P) 


if ne£(T D ) 
otherwise, 
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for 1 < i M < r M . 


Assume that (io 0 v 1 o^ t 1 (v)) is Frechet differentiable, then 


T v i: X £(CW,C in (v))xi: 

aG£(T D ) 


Vi. 


is given by 

T v i(£, C) = [(i o 0- 1 o Xt - 1 (v)) , ((Bv o Xt( v ))(v))](£, <£) = [(i o 0" 1 o x/V))'^ £)](£, <£), 
where (0 V o Xt(v))(v) = (o,£), because ^v((^ in (v)) fcez;(TD) ) = (0 ) k eC(T D ) = o. 

The next lemma describes the tangent map T v i. 

Proposition 4.27 Assume that the tensor product map (ff) is Tjj- continuous. Letv G J 7 T X ('V d) besuchthat 
0 v (v) = (o,C(v)), where <£(v) = {C^) aeTD \ctr D ) eR‘,o= (0) Qe£(TD ) G X ae£(To) £(C/“ in (v), W Q mi ») 
and 

U™ n (v) = span {u^ : 1 < i a < r a } 
for a G Tjj \ {D}. Then the following statements hold. 

(a) The map (io0^ 1 oy t (v)) from X a &C(T D ) W'™ ln (v)) xR* toV,D ||||D is Frechet differentiable, 

and hence 

T v x£c(T v {TT x {y D )),W D „ D ). 

(b) Assume (£, C) G T v (FT x (Vd)), where £ = (C , ^) a eT D \£(T i3 ) € R r and £ = (L a ) ae c(T D ) 
X ae£( T D )>C(C/” in (v),W“ in (v)). Then w = T v i(C, £) if and only 




l<i a <r a aeS(D) aGS(D) l<i a <r a 

aeS(D) 


E E H 


)U 


where 


ul a) = E 

and for each 7 G Tjj \ {D} we have 


*/3 )/3 £S(D) 'ey 

l<*p<rp PeS(D) 

0&S(D) 

PA<* 


U 


(P) 


(4.11) 


(4.12) 


mE 7) ) 


• (7) 

u, u = 


where 


X/1 <ip<rp C, 

/3es( 7 ) 





+ S/3eS( 7 )Sl<i /3 <r )3 ( 

■(h) = \' 

'i-yi'i’P / y 

c £k) 46 » w 0 u S } 

l<is<rs 

SAP 

5es( 7 ) 

«es( 7 ) 

SAP 



fu W) (8) U w) . ) 

\ */3 ) 


if J£C(T D ) 
otherwise, 

(4.13) 


/or 1 < iry < r 7 and 1 < ip < rp. 

Proof. To prove statement (a), observe that for each u Q G t/™ ln (v), a G C(Tjj), the map 

$ Uq : £(t/“ in (v), W Q mi ») -»■ W,f n (v), H- A«K), 
is linear and continuous, and hence Frechet differentiable. Clearly, its differential is given by 

[& a (L a )](H a ) = H a (u„). 
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Also, if the tensor product map 0 is To-continuous, by Proposition 14. 121 the tensor product map 


: X O^ll-llp) ll'll^) “M a 0 ^n-llp ’ II ' II 7 I ’ 

P^S(y) y 0eS(y) ) 

for 7 G Tjj \ C(Td), is also Frechet differentiable. Then, by the chain rule, the map 0” 1 is Frechet differen¬ 
tiable. Since T v i(C, £) = [(i o 0" 1 o y“ 1 (v)) , (£, o)](£, £), (a) follows. Using the chain rule, we obtain (b). 


Let v G FT x (y d) C Vfl,. be such that 


= y d D \ 

Z_/ (*o)«£S(D) 


,(«) 


1 <r a 
aeS(D) 


a&S(D) 


where for each // G To \ ({£>} U £(Td)) we have 

„0) _ 'ST r<(/d 

u v - 2^ 


m , (9) uf 

l<ip<rp 0 eS((i) 

/9eS(M) 


for 1 < iy, < Recall that for a G S(.D) we have 

t/ S( I D)\{a}( v ) = s P an{uL a) : 1 < < r a }, 

and for p, G Tp \ ({D} U £(Td)) we know that £/'™ in (u-^) = U™ ln (v) and 

^IWlf 11 ?) = span{U^ : 1 < ^ < r^} 

for 1 < < r M and /? G 5(/x). Hence 

W|* in (v) = W^u^) for 1 < v < r> and /3 G S( M ). 

In the next proposition we prove that T v i injective when we consider v in the manifold A4 r (V£>). It allows 
us to characterise the tangent space for Tucker tensors inside the tensor space . 

Proposition 4.28 Assume that S(D) = C{Tjj) and the tensor product map (^) is To-continuous. Let 
v G M r (y d), then the linear map T v i is injective and 


T v i(T v (A4 r (V D ))) = 


EC in (v)®[ 0 WT n (v)® a U^ ma} (v) 

a€S(D) 


aeS(D) 

is linearly isomorphic to T v (.A4 r (V£>)). 

Proof. First, observe that if v G A4 r (V d) and w = T v i(£, £), then by Proposition 14.271 b j 


w = E G 


1 <i a <r a aeS(D) 

aeS(D) 


(a) , 
Uj ' + 


E E H? ® u£>), 


where 


u£>= E d D> 


aES(D) l<ioc <r a 


u, (/3) G US 


(ifl)eesw yy C “S(D)\{a}( v ). 

l<if)<rp P€S(D) 

0&S(D) 
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and u-“' = L(u-“ )} ) G fP“ ln (v) for all a G £(Td). Hence T v i(T v (.A/( r (V£>))) C Z( D )(v) where 
Z (D) (v) = q (g) C/r» © 0 W™»(v)® a U$Z Ma} (v) 

a&S(D) \aeS(D) 

Next, we claim that Z^ D ^(v) C T v i(T v (.M r (V£>))). To prove the claim take w G Z^^v). Then we can write 

w = E (^ D % a)aeBW 0 u L a) + E E 

1 <i a <r a aeS(D) aGS(D) l<i a <r a 

aeS(D) 

where w-“^ = tT™ ln (v) for 1 < i a < r a and a G S(D). Recall that 

C/ S( I D)\{«}( V ) = span{U- : 1 < i a < r a }. 

Now, define L a G £([/™ in (v), W“ in (v)) by L a (u\^) := w|“* for 1 < i a < r a and a G S(D). Then the claim 
follows from w = T v i((L a ) a £S(,D), C' D >). To conclude the proof of the proposition we need to show that the 
map T v i is an injective linear operator. To prove this consider that 

Tv. ((i/3)/3e£(T D ),C' (£,) ) = 0, 

that is, 

0 = £ (c^) (iaWs(D) 0 u,L a) + e E (E a) ® u L a) )- 

1 <i a <r a aeS{D) aeS(D) l<i a <r a 

aeS(D) 

Thus, 

E p (d) )w« £S( d) 0 u t ) = 0 ’ 

1 <i a <r a a&S(D) 

aeS(D) 

E (u® = 0 for a G S(D), 

1<Zq, <r a 

and hence C^ = o, because |® ag s(D) u i^} i s a basis of a ® a eS(z>) ^™ m ( v ) i an d L a ( u-“^) < 8 > U-“^ = 0 

for 1 < i a < r a , because the {U-“^ : 1 < i a < r a } are linearly independent for a G S(D). Then L a = 0 for 
all a G S(D). We conclude that 

((-0/3 eC(T D ), C' (£l) ) — ((0)/3 eC(T D ),o) 

and, in consequence, T v i is injective. ■ 

Our next step is to show, by using the above proposition, that if the tensor product map (££) is Tjj- 
continuous then the linear map T v i is always injective for all v G J-T X {Wd)- 

Proposition 4.29 Assume that the tensor product map (^) is Tp-continuous. Let v G FT x (y d), then the 
linear map T v i: X p e c(T D ) £({7™ m (v), W™ ln (v)) xl'->V D n . llo is injective. 

Proof. From Proposition 14.281 the statement holds when S(D) = £(Tjj). Thus assume that S(D) ^ £(Td). 
Then we can write the standard inclusion map i: TT X {Vn) —> V d^.^ d as i d 0 W.d where 



h ,d ■ TT r (V fl ) —x M^) pes(D) 


V* 


0GS(D) 


v i—x v 
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is a standard inclusion map and 


i d ■ M {rp)p 


6S(D) 


is given by 

Using the chain rule, we have 
where 


0 W 

-^ V ^ll ll D 

/8es(r>) / 


C (D) 

(*f0/3eS(7) 

0 <’• 


l<ip< r p 

PeS(a) 


P eS(D) 


T v i = T v ip o T v i v .D, 

,X, 


T v ip : X >C(t/7 n (v), WX m (v)) X ]R A / 3 es(D) r, ^ v D|| 
peS(D) 


is given by 

T v i D ((L a ) aeS[D) ,C^)= tffl 




l<i a <r a 

aGS(D) 


eS(D) 


aeS(-D) 


£ £ (£-(“£’) «u£’) 


x€S(D) 1 <i a <r a 


and 


T v i r ,D : X £(Uy(v),Wy n (v)) xl' ->■ X At/ ? min (v),lb; in (v)) x R x w« D )^ 

P&c(t d ) peS(D) 


is given by 


T v ir,D((i/ 3 )/ 3 G£(r i3 ) ) (C' ( “ ) )aeT i3 \£(r D )) - 


where 5 7 = L 7 if 7 E £(£ 0 ), otherwise 

X(u (7) )= y 

TV I 7 / Z__/ *7>W)(?eS( 7 ) 

l<*/3< r /3 

/3es( 7 ) 

and where for each 7 E Tp \ {D} we have 


u 


!? + £ £ uS>u<«. 

/3eS( 7 ) 0eS("t) l<ip<rp 


T 7 (u| 7) ) 


• (7) 
u; J = 


(t) 




C ’CW)^ 6S (7) &W( 7 ) y + X/3eS( 7 ) Xl<i^< 

^G5(7) 




if 7 E £(Tp) 


otherwise. 


Let w = T v i((Lp) peC{TD] , (C'^) Q eT D \£(T D )) = 0- Since T v i = T v ip o T v i r! D and, by Proposition 14.281 the 
linear map T v ip is injective, then 

T v ir,p((i/ 3 )/ 3 e£(T D ), (C' ( “ ) ) Q , e T D \£(T D )) = ((0)peC(T n )> 0)- 

In particular (b 13 ) = 0 and by Proposition 14. 27f bj. we have 


™ = ° = J2 12 H 

aGS(D) 1 <i a <r a 




(4.14) 


where 


u t’ = £ 0 

l<i/9<r/3 PeS(D) 

PGS(D) 

Pjta 


u 


{P) 
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if 7 G C{T d ) 


and for each 7 £ Td \ {D} we have 
L„(u“) = 7(<>) = 0 
Mi) 


* (7) 
u • = 


/3<ES( 7 ) 


where 


„ ®£)es( 7 ) u *> } + S/3eS( 7 ) S 

l< i 3< r /3 ^ 

u^ /3) . = V C (7) 

iy>ip / _/ Vi(’s)jeS( 7 ) 

0 U ' 


5#/3 

ses(p) 

S<ES(j) 

Sft 3 



(« 


(/?) ^ lj(P). 


otherwise, 


(-5) 
is ’ 


for 1 < iry < r 7 and 1 < ip < rp. We remark that if Sip/) C £(Td) then 


u-~d _ (j{i) 

*7 E_/ i 7 .( i /s)/ 3 es( 7 ) 


*3 


^£5(7) 


/3 es( 7 ) 

t(«) N 


From 0H and the fact that E« eS p) T,i< ia <r a (“i? ® U,-?) e ® a eS(D) ^d)\{c}( v ) we 

obtain that 

E ("if ® u £’) =° 

1 <i a <r a 

for each a £ 5(D). Finally, u|“' = 0, because {Uj“ } : 1 < i a < r Q } are linearly independent vectors for 
each a £ S(D). In consequence, if a £ C(Td ) then nothing has to be done, otherwise we have that for all 
7 ^ £(Td) the equality 


0 = V c h \. , (9) 

z-^i *7>(*/3)3es(7) y~y 
l<ip<rp P€S(i) 

/3eS(7) 


<>+ 


E E (a 

PeS(-y)l<ip<rp 


{0) ® u W) . ) 

IQ ^ 1^,1 p J 


holds for all 1 < i 1 < r 7 . We remark that when S( 7 ) C C(Td) we have 


0 = V c h) r , 

Z—/ l lMp>P£S(-y) 


I (/3) 

*3 


l<ip< r p 


PeS( 7 ) 


and hence we obtain that C^ 7 ) = 0. Proceeding from the leaves to the root in the tree, we check that C^ = 0 
holds for all 7 £ Td \ £(Td) and the proposition follows. ■ 

Now, we want to construct for each v £ TT X {V d) C V.d |M| a linear subspace Z( D \v) C Vd| M | to 
prove that Z^ D ^(v) = T v i (T v (.F7"t(V£)))). To this end assume that 


= ( 0 - 1 ° Xr - 1 (v))(o,e:)= £ cjfj 


1 <i a <r a 
aGS(D) 


<eS(D) 


aeS(D) 


where for each p, £ Td \ ({D} U £(7£>)) we have 

u (m) _ V' Q (M) 

V Z-/ ip>(ip)pes(ii) 

1 <ip<rp 
P£S(a) 

Then to define Z( D )(v) we proceed by the following steps. 
Step 1: For 7 G Tq \C(Td) we observe that 





,( 7 ) 


l<ip<rp 
PeS( 7 ) 


c 


(a) 

tAip)p 


IP) 


es(«) 


G X 




es(7) 


V, 


/3es( 7 ) 


/3es( 7 ) 
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for 1 < i-y < r 7 and /3 G S(j). In particular, = v. Let 


i 7 : 


63(7) 


V fi 


^7||-IU! U T u 7 , 


^6S(7) 


be the standard inclusion map. Thanks to the proof of Proposition ^. 28l we have a linear injective map 


T u ( 7 )i 7 : X £(C/f m (v),W| lm (v)) x R'Wt)’* V 7|| . 

0es( 7 ) 


given by 


T.cWfisW,,<£>) = E < 7 , 


l<ip<rp 

/36 S( 7 ) 


® < } + E E 

/3eS( 7 ) /3€S(j) l<ip<rp 


where U^- = X!i<ij<rj n u i! J for 1 < ip < rp and /3 G 5(y) and also a linear subspace 

<5eS( 7 ) 1(11 

s^t 3 


7(«) 


,(*) 


Z^(u^ } ) := T u ( 7 ) i 7 X £(17™ in (v), W™ in (v)) x 


ySeS( 7 ) 


s X £(U" in (v),lf; in (v))xR X K«^ 
Pes(n) 


for 1 < j 7 < r 7 such that 


ZW (< 7) ) = a ® ^” in (v) © 0 ^(v) S P an { U 5E : 1 ^ */3 < ^} 

/9eS( 7 ) 


for 1 < j-y < r 7 . Since for each 7 G To \C(Td) we can write 

c(u?’)= E 


l<ip<rp 

pes( a ) 


i(*/3)/3eS( 7 ) 




/3es( 7 ) 


for 1 < i-y < r 7 , where 


z (/3) K ( f) := 


(/3) 

u- 

*/3 


if /? g £(ib) 


^( U S } ) = Si<v 5 r ®»eS(0) U V otherwise, 

/xG5(/3) 


(4.15) 


represents that either u-^ G if /3 G £{Td) or G -^(r 7 ) Tes(3) (V^), otherwise. We remark that in 

any case z®(u|^) = In particular, for each v G TT t (V d) we have 

|=w= E O’ 16 ) 

l<ip<rp 0£S(D) 

PeS(D) 


Assume that 

w = T v i ((Lk)keC(T D ), (C' ( “ ) )aeT D \c(r r ,)) = T v i £) ((i / 3 ) / 3 gS ( D ), C ( ' D) ), 
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where {{Lp)p e s(P), C (D ^) = T v i t,D((L k )keC(T D ), (C (a) ) a& T D \c(T D ))- Then, using the chain rule in (14.161) and 
taking into account (14.151) . we have 

. = V C<X S( „ ® <>+ £ £ (u'f ® U<f) 

l<ip<r[) 0eS(D) 0eS{D)l<in<rfi 

0 eS(D) 

where for all fj, gTd\ {D} either ii-^ = L M (u-^) if p, G £(Td) or there exists a unique 

{L,) ieSW G X £(C/™ in (v), W'™ in (v)) 

7^£(Td) 7 eS(/i) 

J^C(T D ) 


such that 



T u (M)v((i 7 )7 e 5 W ,^; ) ) 


V c (D) 

1 J h*; (E ) 7£ 5'(/U 

® <” 

+ E E 

l<y <r> 
fJ-GS(D) 

7 es(/x) 

'y£.S(fji') 1 ^i-y *^7* >-y 

V c ,(D) 

' ; (E ) 7£ S(/-0 


+ E E HXE). 


7 es(/x) 



fieS(D) 


where the last equality is given by Lemma l4.27! b'). In consequence, we obtain that 

u£ } G W™ in (v) for all 7 G Tjj \ {D}. 


Step 2: Now, for each 7 G Tjj \ {D} we define a linear subspace % 7 (v) C W'" lln (v ) r 7 as follows. Let 
"% 7 (v) := IL r ™ ln (v) r '' 1 ' if 7 G £(Td). For 7 ^ £(Tb) we construct % 7 (v) in the following way. Let 


T 7jV : R^ xX ^s( 7 ) x X ^(v) —► IF 7 min (v) r 
/3eS( T ) 


be a linear map defined by 


T 7 jV (C > W,((wJ ) )^ = 1 )^ s(7) ) := (w|%i, 


where 


rrW ^ „(«n_ w W^U (/3) - 


E (iW 

*7>(*/3)/3eS( 7 ) 

/3€S(t) 

/3eS(7) 


E E 

0£S(~i) 1 <ip<rp 


for 1 < i 7 < r 7 . Let : R r 7 x x /ses(7) r /3 


»X, 


/3£S( 7 ) b e given by TTi y (C^) = C^, for 1 < i 7 < r 7 . 
(7) <■ , ^ ^ „„ 1 f /„ \_„.(/ 3 ) 


Observe that if we define i 7 (u| 7 ^) := w- 7 ^ for 1 < i 7 < r 7 and Lp(ui p ) := w,j^ for 1 < i /3 < rp and 
/3 G 5 ( 7 ), then 

< T) = T u ( 7) i 7 K(C (7) ), (i /3 ) /3e s (7 )) 6 zW(uJ>) 

z-y 

for 1 < ij < r 7 , and hence by Proposition 14.271 the map Y 7iV is injective. Finally, we define the linear 
subspace 

U-y (V) := T 7iV I R r 7 X X /3£S(7) r 0 x X W/9 ( v) ) . 

V /3es( 7 ) / 

For 5 £ T d \ {D} let n i4 : lff' n (v) r ‘ -4- W™ ln ( v ) be given by n is ((w^)^ =1 ) := for 1 < is < r s . 
Observe, that for each (3 G 5 ( 7 ), we can identify (w^)^ =1 G 7t^(v) with 


E = E n.,((wg>)S.,)®u;® 


*/3 
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for 1 < i 7 < r 7 . It allows us to construct an injective linear map 

//3,i 7 : Upiy) — ► (wg } )i; =1 ^ w <f 

l<ip<rp 

for 1 < * 7 < r 7 . Hence (LLpiy)) is a linear subspace of b©. ,, linearly isomorphic to Hp{v) for 1 < i 7 < i 


Thus, 


where 


7||- 

n (u M) = ( a ®W (7 ) ^ min(v) 0 (©^( 7 ) W^( v ))) if 7 £ ^(Tb), 

* 7 \ W 7 min (v) if 7 € CiTjj), 

, mnul ©£=i W v )) ®« span{u|^ } if p £ C{T D ) 

^ ^ { ©^=iW7 in (v)®aSpan{U^} if 0 £ C(T D ) 


for 1 < i 1 < r 7 . 


Step 3: Finally, we construct a linear subspace Z^ D i(v) C V.d |M| by using a linear injective map 

Td, v :K X “ es ( D)r “ x X fta(v)—►V D|M|b 

aeS(D) 


clehned by 
where 


T 7 , v (C^,((w^)r :=1 ) aeS(D) ):= 


== E 


MO ^ ^ £ w, (a) g>uf a) . 


u 


0a6S(D) 

aeS(D) a£S(D) l<i a <r, 

aeS(D) 


Then Z^v) := T DjV (k x «€s ( d) r a x X ae S(D) % a (v)^ and from Step 1 we have that 

T v i(T v (Jr t (V D )))cZ ( °)(v) 

holds. Moreover, we can introduce for each a £ S(D) a linear injective map 
Id, a ■ U a {w) -tV D|| . |fl , (WiJ-“ =1 •—t 5Z 


(a) tt^) 

w; 0 U; . 


1 <i a <r a 


Then f d ,a(7~La{v)) is a linear subspace in V,d |m|d linearly isomorphic to 7i a {v). It is not difficult to show 
that 

, ('U ( v \\ - I ©ir=i ni «(^«(v)) ® a span{ u ^ ) } ifa^£(T D ) 

a( | ©•: =1 WT n (v)® 0 span{u£ ) } if a £ C{T D ) 

for a € S(D). By construction, we have 


Z' D) (V) = a 0 EC in (v) © 0 /Z>,a(«a(v)) ] . 

aeS(D) \aeS(D) 


Proposition 4.30 Assume that S(D) ^ £(Td) and the tensor product map (££) is Tjj- continuous. Let 
v £ TT v (V d ), then T v i(T v (J r T r (V£)))) = Z ( -°i(v) and hence it is linearly isomorphic to T v(fFTt(V d))- 
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{1,2,3} 



{2} {3} 


Figure 4.4: A binary tree Tp. 


Proof. From Step 1 and the construction of Z^ D ^(v), the inclusion T v i(T v (.FTr(V£>))) C Z^ D \w) holds. 
Now, take w £ Z^ D ^(v). Then we can write 


w= E ( d(D) k 


i a )c 


es(D) 


l<i a <r a 

aeS(D) 


aeS(D) 


E E 


a£S(D) 1 <i a <r a 


where £ R x <*£S(d) r <* andw^ G lT™ n (v) for 1 < i a < r a - Then we can define £ a G £(C/™ ln (v), lT™ ln (v)) 
by L ct (u-“' ) ) := w-“^ for 1 < i a < r a , and we have 

(C (D) ,(i a ks ( D))GR X «^) r «x X £(U™ n (v),W™ n (v)). 

aGS(D) 

Moreover, Xi <i a <r a ® U i^ e fD, a (P a (v)) for a £ S(D). If a £ C(T D ), then (w |“ ) )}“ =1 G %*(v) = 
T a ,v ^M raX x / 3 es( 7 ) r 3 x X / 3 e 5 ( a ) . Hence there exists 

(^.((wf^WwJGR^^^I^X X ^(v) 

P €S(a) 


such that 


w': 1 = e <tl 


® <’+ E E w«f®u<f>„ 

fiES(oi) fiES(a) l<ip<rp 

pes(a) 


for 1 < i a < r a . Define Lp( u-^) := w-^ for 1 < ip < rp and (3 £ S(a). Then 

(C (o) ,(% %) )Gr^ x ^)^x X £(H™(v),IT™(v)). 

P 6S(a) 

Moreover, Ei<^< rfl w lf ® u !f^ G fp,i a CHs( v )) for 1 < i a < r a . If /3 £ E(T D ), then (w ^)^ =1 G 
Hp(y) = T^v (r^ xX 7esc«r T x X 7 eS(/3) ^ 7 ( v )) • Proceeding in a similar way from the root to the leaves, 

we construct (£, C) G T v (.FTr(Vzj)), where £ = (C ,( “ ) ) Qe T D \£(r D ) G K r and £ = (i a ) ae T D \{-D} G £t d ( v ) 
such that w = T v i(£, £). Thus, we can conclude that Z^^v) C T v i (T v (.FTt(V.D))) and the equality 
follows. ■ 

Example 4.31 Consider the binary tree Tp given in Figure \Clj\ and consider TB ranks r = (1, ri, £ 23 , £ 2 , £ 3 )- 
Let v G iFTxiVi ® a V 2 < 8 > a V 3 ) and assume that the tensor product map (ff) is Tp-continuous. Then 


where 


z (123) (v) = (DT m (v) 0 O f7™(v)) ®/l23,l(Hl(v)) ® /l23,23('H23(v)), 

ri 

/i23,i(^i(v)) = 0 lPi min (v) ® a spanjU^} C Vr |H|i ® a (V 2|l , l2 ®a V^lis) , 

*i=i 

r 23 

/l23,23(H 23 (v)) = 0 Span{U| 2 2 3 3) }® a n i23 (H 2 3 (v)) C Hi |m|i ®a (H 2|| , |2 ®a V 3 M3 J , 


^23 — 1 


40 


and 


n i23 (H 23 (v)) = (<7 2 min (v) © a t/ 3 mhl (v)) 

© ( 0 W 2 min (v) ©a span{U^ il2 }J © ( 0 S pan{ug ii3 } ® a IF 3 min (v) 

Vi2=l / \i 3 = l 

which is a linear subspace in V 2 u . it2 © a ^3||.|| 3 - 

4.2.2 Is the standard inclusion map an immersion? 

Finally, to show that i is an immersion, and hence J 7 'T v (Vd) is an immersed submanifold of V_D| M | d , we need 
to prove that T v i (T v (J r T r (V£)))) £ G(V||.|| D ). Let {V Q|| , ||q } a gr D \{fl} be a representation of the Banach 
tensor space V d ]1]]d = |[i,|[ D ® jeD Vj , in the topological tree-based format and take Vji := a ■ A 

first useful result is the following lemma. 



Lemma 4.32 Assume that (14.101) holds. Let a £ Td\£(Td) and take /3 £ S(a). IfWp £ G(V^ || satisfies 
V, = Up © Wf 3 for some finite-dimensional subspace Up in ^ , then Wp ® a U[p ] £ G(V a|| ||q ) for 
every finite-dimensional subspace U[p ] C a (S><5es(a)\/3 n 5 • 

Proof. First, observe that if Wp is a finite-dimensional subspace, then Wp ® a U ^ is also finite dimensional, 
and hence the lemma follows. Thus, assume that Wp is an infinite-dimensional closed subspace of ^ , 
and to simplify the notation write 


^-0 '■ IHIv(s(<*)\« 0) ^ihu ' 

5GS(a)\{/3} 

If Uipi C is a finite-dimensional subspace, then there exists Wrgi £ G(X^) such that Xp = Utpi © W\py 
Since the tensor product map 


0 1 ( V /3|H|@ J II ' 11/3) X ( X © II ’ II V(S(a)\/3)) (V a|| . ||o , || • ||«) 


is continuous and by Lemma 3.18 in mi, for each elementary tensor \p © v^j £ n ® a Xp we have 


\\{idp ® P U[fj]S)W[fj] ){vp © v [/3 ])|| a < C dim U m || vp ||^ ||v [/3] || V (S(a)\/ 3 ) 

= C Y^dirn U[p] ||vp © v [/3] || v(S(«)) 

< C' dim U [^j ||V /3 © v I/3 ]|| a . 


Thus, ( idp © P u m ®w m ) is continuous over ^ © a X^, and hence in V a|| ||Q . Now, take into account the 
fact that 

idp = P Uf<@W/j + P WfjS)Uf) , 


so that 


idp © -Pu Iffl @w [i8] © ^ u m® w W + P w p ®u fi © P v m • 

Observe that idp © P u m ®w m and © P u m <s>w m are continuous linear maps over V> |H| 

then P Wfj@Ufj © p u@w i s a continuous linear map over ^ © a X.p. Thus, 


© a Xp, and 


P a ■ Pwpisup © P u m <8W m e 


and P a ° P a — Pa ■ Since )P a (V Q|| ) = Wp © a U[p\, the lemma follows by Proposition 13.41 
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Lemma 4.33 Let X be a Banach space and assume that U, V £ G(X). IfUtlV = {0}, then U ®V £ G(AT). 
Moreover, U PI V £ G(X) holds. 

Proof. To prove the first statement assume that U 0 V = {0}. Since U, V £ G(A') there exist U' , V' £ G(X), 
such that X = U®U' = V®V'. Then U = XnU = {V®V')CU = UC\V' and V = XtlV = (i U®U')C\V = 
V n U'. In consequence, we can write 

u®v®{u'nv') = (un v’) ® (v n u') ® ([/' n v') = {u® u') n iv ® v') = x, 

and the first statement follows. To prove the second one, observe that X = (U C\V) ® (U C\ V') ®(bfl U') ® 
(U'nV). U 

A very useful consequence of the above two lemmas is the following Theorem. 

Theorem 4.34 Let {V a|| ||q } a eT D \{£>} be a representation of a tensor Banach space Vd [111d = \\-\\D®j£D^j 
in the topological tree-based format and assume that (14.1011 holds. Then Z^(v) £ G(V.d |M| ), and hence 
d) is an immersed submanifold o/V.d |M| . 

Proof. Since the tensor product map is T/j-continuous, Proposition 14.271 gives us the differentiability of T v i- 
Assume first that S(D ) = C(Td). From Corollary 14.281 we have 

Z (D) (v) = a 0 C/“ in (v)ffi( 0 W™ n (v)® a U$Z Ma} (v) 

a£S(D) \aeS(D) 

For each a £ S{D) we have W“ in (v) £ G(V« |M| J and C/“ ( “ )Ua} (v) C o 0 5 e 5 (ZJ) \ {a} V 5|| . ||s is a finite¬ 
dimensional subspace. From Lemma 14.321 we have W'“ ln (v) (g> a ^™( I d)\{ q ,\( v ) £ G(V.d |M| d ) for all a £ S(D). 
Since a <S) a& s(D) ^““(v) £ G ( V £>imi d )> b y Lemma[031 we obtain that Z (IJ) (v) £ G(VD u . II|g0 )• 

Now, assume that S(D) ^ £(Td). Then 



Z (D) (v) = a 0 ^““(V)® 
aeS{D) 


0 /D.aCft a(v)) 

la€S(fl) 


and 


/D,«CWa(v)) = 


©L “=1 (7k ( v )) span{u£ } } if a £ C{T D ) 

. ©i“=i bF™ in (v) span{U^} if a £ C{T D ) 

for a £ S(D). For a £ £(Td) we have lT“ ln (v) £ G(V a|| ||q ) and span{U-“^} is a finite-dimensional 
subspace for 1 < i a < r a , and from Lemma [4.821 VF™ ln (v) ® a span{U-“^} £ G(V_d | m|d ) for 1 < i a < r a . By 
Lemma 14.331 /d j 0 (^q(v)) £ G(Vo t| ). Otherwise, if a ^ £(Td) then 


f d, a(f~La (v)) = 0 n jQ ('H a (v)) ® a span{U®}, 

i a =1 


where 


n i a (H a {v)) = a 0 Uf n (v)® 

0£S(a) 


0 fp,i a (Hp(v)) 

eS(a) 


for 1 < i n < r„. Now, 


f (V ( It - / ©?=1 OW) ®« span{U©^} if p i C(T D ) 
^ 1 ®[0^ min (v)<8)aspan{u5 3 } if /3 £ C(T D ) 
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for 1 < ia < r a . Clearly, if 0 G £(Td) then fp,i a ('Hp(v)) G G(V a|| ||q ) for 1 < i a < r a . Then we can write, 



/ 

) 


/ 

\ 

n= a 0 uf n (v)® 

© 

J?* 

0 

(T- 0 M) 

© 

© f0,ic 

Wv)) 

0 eS(a) 

0 eS( a ) 
\0eC(T D ) 



0 es(a) 

\P<4C{T d ) 

/ 


for 1 < i a < Starting from the leaves, that is 7 G we have that ^(^(v)) = W™ m (v) G 

G(V 7 ||.|| ) for 1 < ij < r 7 , and hence for 5 GTd such that 7 G 5(5) we obtain / 7 ,i 5 (H 7 (v)) G G(V,5 |M| ) for 
1 < ig < rg. Proceeding inductively from the leaves to the root, we obtain that fp,i a {'Hp{v)) G G(Vq, |M| ), 
for 0 G S(a) with 0 ^ £(Td) and 1 < i a < r a . Lemma 14.331 savs us that n ia ('H ct (v)) G G(V a|| . |u ) for 
1 < i a < r a . From Lemma 11.321 and Lemma 14.331 we obtain that f d ,a{H a {y)) G G(V£> INI )■ Also by 
Lemma 14.331 we have Z( D i(v) G G(Vdh. |I d ), that proves the theorem. ■ 

Example 4.35 Let us recall the topological tensor spaces introduced in Example \4- 3\ Let Ij C R (1 < j < d) 
and 1 < p < 00 . Given tree Td, let I a := X j ea Ij for a G Tn- Hence L p (I a ) is a tensor Banach space for 
all a G Tjo- In this example we denote the usual norm of L p ( I Q ) by || • ||q, iP . Since || • || ajP is a reasonable 
crossnorm (see Example 4-12 in urn then (14.101) holds for all a G Td. From Theorem \4-34\ we obtain that 

FTx ( a ®j=i L p (Ij) ) is an immersed submanifold of L p (Id). 


Example 4.36 Now, we return to Example o From Example 4-4 % i n m we know that the norm 
II • ||(o,i),p is a crossnorm on H 1,p (Ii) ® Q H 1,p (l 2 ), and hence it is not weaker than the injective norm. In 
consequence, from Theorem\4-34\ we obtain that FT t (H 1 ’ p (Ii) ® a H 1 ’ P (1 2)) is an immersed submanifold in 
Hl ' P (Ii)®M<o, lhP H 1 ' p {l2). 

Since in a reflexive Banach space every closed linear subspace is proximinal (see p. 61 in E9). we have 
the following corollary. 


Corollary 4.37 Let {V Q|| ||q } 0 gT D \{D} be a representation of a reflexive tensor Banach space V(d |M| = 
INIo ®j£D Vj in the topological tree-based format and assume that (l4.10D /tolds. Let v G FT t (V d), then for 
each u G V.d |M| there exists Vbest G Z^ D ^(v) such that 


||u - v&est|| = min ||u - v||. 
vez(®)( v ) 

Using the standard inclusion map i : FT < r (V d) —> Vd |m|d the following result can be shown. 

Corollary 4.38 Let (V a|| ||q } a er D \{Z5} be a representation of a tensor Banach space~V d^.^ d = |H| D ®jeD Vj j 
in the topological tree-based format and assume that (14. 101) holds. Then FT < r (V d) is an immersed subman¬ 
ifold o/V D|M| d . 


5 On the Dirac—Frenkel variational principle on tensor Banach 
spaces 

5.1 Model Reduction in tensor Banach spaces 

In this section we consider the abstract ordinary differential equation in a reflexive tensor Banach space 
v a,n D , given by 


u(t) = F(t, u(t)), for t > 0 (5.1) 

u(0)=uo, (5.2) 

where we assume u 0 ^ 0 and F : [0,oo) x Vb |M — > satisfying the usual conditions to have 

existence and unicity of solutions. Let {V Q|| ||q } a eT D \{.D} be a representation of V = ||.|| D ®j^D Yj i n 
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the topological tree-based format and assume that (14.101) holds. As usual we will consider = a® j<z D Vj . 
We want to approximate u(t), for t £ I := (0,e) for some e > 0, by a differentiable curve t i-» v r (t) from I 
to FTxiy d), where r € N Td is such that v r (0) = u(0) = u 0 £ TT X (Yd)- 


Our main goal is to construct a Reduced Order Model of (15.11) (15.21) over the Banach manifold d)- 

Since F(f,v r (f)) £ Vz3 N .n 5 for each t £ I, and Z (D )(v r (t)) is a closed linear subspace in we have 

the existence of a v r (t) £ (v r (t)) such that 

||v r (t) -F(t,v r (t))\\ D = min \\v(t) - F(t,v r (t))\\ D . 

v(t)£Z( D >(v r (t)) 


It is well known that, if Vd ini is a Hilbert space, then v r (t) = V Vr (t)(F(t, v r (t))), where 


'Pvr(t) - 'Pzm ( Vr (t))®z<. D f Vr (t))- L 


is called the metric projection. It has the following important property: v r (f) = V Vr [t)(F(t, v r (t))) if and 
only if 


(vy(i) — F(t, v r (t)), v(t)) D = 0 for all v(t) £ Z < ' D \v r (t.)). 


The concept of a metric projection can be extended to the Banach space setting. To this end we recall 
the following definitions. A Banach space X with norm || ■ || is said to be strictly convex if \\x + y ||/2 < 1 
for all x, y £ X with ||x|| = ||j/|| = 1 and x ^ y. It is uniformly convex if linin^oo \\x n — y n || = 0 for any two 
sequences {x„} ne N and {y n }neN such that ||x„|| = \\y n \\ = 1 and linpj^oo \\x n + y n ||/2 = 1. It is known that 
a uniformly convex Banach space is reflexive and strictly convex. A Banach space X is said to be smooth if 
the limit 


lim 

t —>-0 


x +; 


- x 


exists for all x. y £ U := 
modulus of smoothness 


{z £ X : \\z\\ = 1}. Finally, a Banach space X is said to be uniformly smooth if its 
|[x + ry|| + || x — ry\\ 


p(t) = sup 

x,y£U 


~ 1 , r > 0, 


satisfies the condition lim r _ > o p{ T ) = 0. In uniformly smooth spaces, and only in such spaces, the norm is 
uniformly Frechet differentiable. A uniformly smooth Banach space is smooth. The converse is true if the 
Banach space is finite dimensional. It is known that the space L p (1 < p < oo) is a uniformly convex and 
uniformly smooth Banach space. 


Let (■, •) : X x X* —> R denote the duality pairing, i.e., 

(x,f) := f(x). 

The normalised duality mapping J : X — > 2 X is defined by 

J(x) := {/ £ X* : (x,f) = ||x|| 2 = (||/||*) 2 }, 
and it has the following properties (see [2]): 

(a) If X is smooth, the map J is single-valued; 

(b) if X is smooth, then J is norm-to-weak* continuous; 

(c) if X is uniformly smooth, then J is uniformly norm-to-norm continuous on each bounded subset of 
X. 


Remark 5.1 Notice that, in a Hilbert space and after identifying X with X*, it can be shown (see Propos¬ 
ition 4-8(i) in w that the normalised duality mapping is the identity operator. 
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Let {V a , ||Q }ceeT D \{D} be a representation of a reflexive and strictly convex tensor Banach space V = 
II'IId 0JGD Vj , in the topological tree-based format and assume that (Id. 101) holds. For F(i, v r (t)) in V£> |M| , 
with a fixed t G /, it is known that the set 

jv r (t) : ||v r (t) - F(t, v r (i))|| D = min ||v(f) - F(i, v r (f))||r, 1 
l v(t)ez( D )(v r (t)) J 

is always a singleton. Let V Vr (t) be the mapping from V.d |M| onto Z < ' D ' ) (v r (t)) defined by vy(f) := 
K r (t)( F (t, v r(t))) if and only if 

||v r (t) - F(t, v r (i))|| D = min ||v(i) - F(t, v r (t))|| D . 

v(t)ez( D )(v r (t)) 

It is also called the metric projection. The classical characterisation of the metric projection allows us to 
state the next result. 

Theorem 5.2 Let {V a|| ||Q }aer D \{D} be a representation of reflexive and strictly convex tensor Banach 
space V.D||.|| = II-IId Vj vn the topological tree-based format and assume that | f.lO\ ) holds. Then for 

each t G I we have 

Vr (t) = V Vr (t) (F(t, V r (t))) 

if and only if 

(vy(t) — v(t), J(F(t, v r (t)) — v r (t))} > 0 for all v(f) G Z^ D ^(v r (t)). 


An alternative approach is the use of the so-called generalised projection operator (see also [2j). To 
formulate this, we will use the following framework. Let Tp a given tree and assume that for each a G Tjj 
we have a Banach space V Q|| ^ , such that (14.101) holds and where V^n ^ is a reflexive, strictly convex and 
smooth tensor Banach space. Following m , we can define a function f) : V_d |m|d x V_d |m|b —> K by 

cf{u,v) = ||u|||, - 2(u, J(v)} + ||v|||,, 

where (•, •} denotes the duality pairing and J is the normalised duality mapping. It is known that the set 


v r (f) : 


-{t)))= min </>(v(f),F(t,v,.(f))) 
vO)ez< D >(v r (t)) 


is always a singleton. It allows us to define a map II Vr (t) : v r>n.|i D —>• z[D) (yr (i)) by vy (t) := n Vr(t) (F(t, v r (t))) 
if and only if 

0(vr(t),F(t,v r (t))) = min 0(v(t), F(t, v r (t))). 
v(t)ez( D )(v r (t)) 

The map LI Vr ( t ) is called the generalised projection. It coincides with the metric projection when V_d | m| ^ is 
a Hilbert space. 


Remark 5.3 We point out that, in general, the operators - P Vr (t) and n Vr (t) are nonlinear in Banach (not 
Hilbert) spaces. 


Again, a classical characterisation of the generalised projection gives us the following theorem. 


Theorem 5.4 Let {V Q|| ||q } a gT D \{D} be a representation of reflexive, strictly convex and smooth tensor 
Banach space Vd |N| = ||.|| D Vj In the topological tree-based format and assume that (14. 101) holds. 

Then for each t € I we have 

v r (t) = n Vr ( t ) (F(t, v r (t))) 


if and only if 

(' v r {t ) - v(t), J(F(£,v r (i))) - J(v r (t))) > 0 for all v(t) G Z {D) (v r (t)). 
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5.2 The time-dependent Hartree method 

Let (•, •) • be a scalar product defined on Vj (1 < j < d), i.e., Vj is a pre-Hilbert space. Then V = a (g) . =1 Vj 
is again a pre-Hilbert space with a scalar product which is defined for elementary tensors v = (S>j=i and 
w = i by 

Id d \ d 

(v, w) = / \ := for all G Vj. (5-3) 

\J=1 3=1 / 3=1 3 

This bilinear form has a unique extension (•,•) : V x V —>• R. One verifies that (•, •) is a scalar product, 
called the induced scalar product. Let V be equipped with the norm ||-|| corresponding to the induced scalar 
product (•, •). As usual, the Hilbert tensor space V||.|| = ||.|| (S>j=i Vj the completion of V with respect 
to ||-||. Since the norm |j-|| is derived via (15.31) . it is easy to see that ||-|| is a reasonable and even uniform 
crossnorm. 

Let us consider in V||.|| a flow generated by a densely defined operator A G L(V||.||, V||-||)- More precisely, 
there exists a collection of bijective maps ip t : V(A) —> D(A), here T>(A) denotes the domain of A, satisfying 

(i) <p Q = id, 

(ii) Vt+s = ft 0 <P S , and 

(iii) for u 0 G T>(A), the map t <p t is differentiable as a curve in V||.||, and u(t) := y>j(u 0 ) satisfies 

u = Au, 
u(0) = u 0 . 


In this framework we want to study the approximation of a solution u(f) = y> t (uo) G V||.|| by a curve 
v r (t) := A(t) ®jLi Vj(t) in the Hilbert manifold _M(ii)(V), also called in 25i the Hartree manifold. The 
time-dependent Hartree method consists in the use of the Dirac-Frenkel variational principle on the Hartree 
manifold. More precisely, we want to solve the following Reduced Order Model: 

v r (t) = V Vr .(t)(Av r {t)) for t G /, 
v r (0) = v 0 , 

with v 0 = Ao <8>j = i Vq 3> G ■M(i ) ... ) i)(V) being an approximation of U(d By using the characterisation of the 

metric projection in a Hilbert space, for each t > 0 we would like to find v r (t ) e T Vr(t) i (T Vr .{ t) (A^(1.1) (V))) 

such that 

(v r (t) -Av r (t),v(t)) = 0 for all v(t) G T Vr(t) i (T Vr . (t) (M (1 ..^(V))) , (5.4) 

v r (0) = v 0 = A 0 ®j =1 v^ J \ 

and where, without loss of generality, we may assume 11 z;q J ^ ||j = 1 for 1 < j < d. A first result is the following 
Lemma. 

Lemma 5.5 Let v G C 1 (/,W(v 0 )), where v(0) = v 0 G A4(i i ... i i)(V) and (£/(v 0 ), 0 Vo ) is a local chart for v 0 
in A4(i i) (V). Assume that v is also a C 1 -morphism betweenthe manifolds I C 1 anc!W(vo) C 
such that v(i) = A (t) (S>j= i v j(t) f or some A G C 1 (I, K) and Vj G C 1 (I, Vj ) for 1 < j < d. Then 

d d 

v(t) = A(t)0Uj(i) + Ht)^2vj{t) <g> (g)v k (t) = T v(t) i(T t v(l)). (5.5) 

3=1 3=1 

Moreover, if Vj(t) G Sy^, i.e., ||wj(t)||_y = 1, for t G I and 1 < j < d, then Vj(t) G TV( t )(§y,) f or t G I and 
1 <3 <d. 

6 Indeed, vq can be chosen as the best approximation of uq in because = 7(i } ... } i)(V) \ {0}. 
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Proof. First at all, we recall that by the construction of 5/(v 0 ) it follows that ^“‘“(vo) = W7 min (v(£)) 

and that t/™ m (vo) = span{wo^} is linearly isomorphic to 17 J min (v(t)) for all t £ I and 1 < j < d. Assume 
©v 0 (v(t)) = (A(£), Lift), ..., L d (t)), i.e., 


v(t) := A + Lj(t)) (v^ } ), 

.7=1 

where A e C 1 (/, R \ {0}), Lj £ C^J, £(P“ ln (v 0 ), W™ m (v 0 ))) and (idj + Ljft))(v^) £ f7™ ln (v(£)) for 
1 < j < d. We point out that the linear map T t v : R —> T v ( t )(A / J(i i ... j i)(V)) is characterised by 

T t v(l) = (0 VO o v)'(t) = (A ft), L^t),L d (t)). 


(5.6) 


Since Lj £ C 1 (J,£(C/j nin (vo), Wf^vo))) then Lj £ C°{I, £(C/j nin (v 0 ), H7 min (v 0 ))). Observe that Uf^fvo) 
and Pf m (v(£)) have W™ ln (vo) as a common complement. From Lemma lib 61 we know that 

^(/f n (v»)®ff” n (vo)l(/” in (v(i)) : U^fvft)) > J7™ m ( v o) 

is a linear isomorphism. We can write 

Lj{t) = Lj(t)Pljm. in( Vo )®VVmin( Vo ) aild Ljft) = Lj (t)-Pf/inin( Vo )® W?” ln ( Vo ) ) 
and then in (15.61) we identify Ljft) £ £(C/™ m (vo), W™ m (vo))) with 

AjW^C/j nln (vo)©W'j nin (v 0 )li7J nin (v(j;)) € >C(C/j nin (v(t)),Wj nm (vo))). 

Introduce u,-(£) := (idj + Lj(t))(v for 1 < j < d. Then 

LjitfiVjft)) = i J (£)P (7 mi„( Vo ) ew -min( Vo )| a min( v ( t ^(77^' ) + Lj ft) (Vq^ )) = Lj (t) (Vg^ ) 
holds for alH S I and 1 < j < d. Hence 

= Lj( t )( v o ) ) = Lj(t)(vj{t)) 

holds for alH S I and 1 < j < d. From Lemma r4.27f bl and (15.61) . we have 


(5.7) 


T v (t)i(T t v(l)) = A(£) 0 u,(£) + A ft) ^ Lj(t)(vj{t )) <g> 0 Vfc(£), 

j=l j=l k^tj 

and, by using (15.71) for v(t) = A(t) <S>j=i v j(t)> we obtain (15.51) . 

To prove the second statement, recall that t/” lln (v(£)) = span {wj(£)} and Vj = f/j nm (v(£)) ® ^“‘“(vo) 
for 1 < j < d. Then we consider 

W™ ln (vo) = spanjwj^)}- 1 - = {uj £ Vj : (uj,Vj(t))j = 0} for 1 < j < d, 


and hence (vj(t)),Vjft))j = 0 holds for 1 < j < d. From Remark 13.201 we have ... , v d (t)) £ 

C(I, Xj =1 T v . m (Svj)), because W™ in (v 0 ) = T^ (t) (§^) for 1 < j < d. ■ 

Before stating the next result, we introduce for v r (t) = A(t) ®^ =1 Vj(t) the following time dependent 
bilinear forms 

a k(t; -, •) : V k x Vk —* R, 
by 

a k{t;z k ,yk) := ( A ^t®0 b( f ) > Vk <S> 0 Vj(t) 

\ \ J^k J \ j#fe 

for each 1 < k < d. Now, we will show the next result (compare with Theorem 3.1 in [251 ). 
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Theorem 5.6 (Time dependent Hartree method) The solution v r (t) = A(t) (S>j=i v j(f) f or (?ii(t), • ■ • > v d(t)) E 

xL§v, 0/ 


J = 1 

satisfies 

and 


v r (t) = P Vr (t)(Av r (t)) for t £ J, 
v r (0) = v 0 , 

(vj(t),Wj(t))j - a j{t;Vj(t),Wj(t)) = 0 for all w 3 {t) £ T„ iW (Svj), 1 < j < d, 

A(t) = A 0 exp (A (®j =1 Vj (s)) , (s)) ds^j . 

Proof. From Lemma 1531 we have T Vr ( t ) (V)) = R x X^ =1 ), Thus, for each w(f) £ 

T v (t)*(T v (t) (A4(i,..,i)(V))) there exists (/3(t), Wi(t ),..., w d (t)) £Rx Xj = 1 T Vj ( t )(S Vj ), such that 


r (t) = Pit) <S> v o( t ) + A 0) H Wji*) ® 0 'V. (0- 
4=1 j=i 


Then (15.41) holds if and only if 


d d \ 

v r (t) - Av r (t),/3(t) 0Wj(t) + A (t)^2wj(t) ® \ =0 

i=i i=i Mi / 


for all 0(t),wi (t), .. .,w d (t)) £ R x X j=1 T^^Sy,.). Then 


A(t)/3(t) + A(t) 2 ^ [ (vj(t),Wj(t))j - (t),Wj(t) ® 0»i(t)) 


i=i 


S=1 




-A(t)4(f )<>i0H-(t),0K(t)) = o, 

i=i 4=i 


i.e., 


>b=i w i 


/3(f) (A(t) - A(t)(^0^ =1 Wj(t),0' 

+A(f) 2 ^ = i ((i>j(t),Wj(t))j - (-40^=1 «*(*),^i(i) ®0 fc ^Wfc(t))) = 0 

holds for all /j(t) £ R and (wi(t),... ,Wd(t)) £ X^ =1 T tlj ( t )(Sy^). If A(f) solves the differential equation 

A(f) = (A (®j =1 Uj(t)) , <g^ =1 u,(t)) A(t) 

A(0) = Aq, 


(5.8) 


i.e., 


A(t) = A 0 exp ^ (A (s)) , (s)) ds^j , 

then the first term of (15.81) is equal to 0. Therefore, from (15.81) we obtain that for all j £ D, 


(v j (t),w j (t)) j - (A^Qv s (t),Wj(t) <g> 0 v k (t)) = 0, 
s=l Mi 


that is, 


{vj(t),Wj{t))j - a,j(t;Vj(t),Wj(t)) = 0 
holds for all vbj(t ) £ T„.( t )(§vj)j and the theorem follows. 
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